2024-05-06 14:12:17.476 WARN 17654 --- [pool-ocp-async-2,fec97e4325154205,520db1f778ef] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:17.884 INFO 17654 --- [pool-prometheus-minute-schedule-1,18aeae00e6cf4a47,e53cedaf6859] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714975980, interval=60 2024-05-06 14:12:17.893 INFO 17654 --- [pool-prometheus-minute-schedule-1,18aeae00e6cf4a47,e53cedaf6859] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:17.972 INFO 17654 --- [pool-ocp-async-1,3b0c9279dd524770,bc1b09074dc1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:18.066 INFO 17654 --- [pool-ocp-schedules-2,b4e0d573bd9e4c16,b34169b4b10e] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-05-06 14:12:19.156 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 172.17.0.1:8080 refreshes policies... 2024-05-06 14:12:19.157 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-05-06 14:12:19.476 WARN 17654 --- [pool-ocp-async-8,9edfe5fef25040d1,e99d8d15d85b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:19.972 INFO 17654 --- [pool-ocp-async-10,99ca99e20df24346,44413296e3d5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:20.260 INFO 17654 --- [pool-ocp-async-8,276f03d886d445f9,c14565f74840] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-05-06 14:12:20.290 WARN 17654 --- [pool-scanner-115275000-1,276f03d886d445f9,ce25ed49cd32] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 6 2024-05-06 14:12:20.353 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-05-06 14:11:20.0, nextRun=2024-05-06 14:12:20.0, currentDate=Mon May 06 14:12:20 CST 2024 2024-05-06 14:12:20.353 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999996, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2024-05-06 14:11:20.0, nextRunTime=2024-05-06 14:12:20.0} 2024-05-06 14:12:20.376 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2024-05-06 14:12:20.376 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.m.r.t.m.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2024-05-06 14:12:20.376 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Collect all cluster compaction info', taskDefinitionId=999996, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='172.17.0.1', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2024-05-06T14:12:20.376+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Collect compaction for all clusters, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='e6731b8a02884b1b', operation=EXECUTE} 2024-05-06 14:12:20.576 INFO 17654 --- [alarm-task-1,9d1cb1ba51044be6,9a487cc7496d] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-05-06T14:12:20.574877+08:00, lastProcessTime=2024-05-06T14:12:10.536994+08:00 2024-05-06 14:12:20.884 INFO 17654 --- [pool-prometheus-minute-schedule-1,e7555d659dc14112,7b644e8f630f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714975980, interval=60 2024-05-06 14:12:20.890 INFO 17654 --- [pool-prometheus-minute-schedule-1,e7555d659dc14112,7b644e8f630f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:20.891 INFO 17654 --- [alarm-task-1,9d1cb1ba51044be6,9a487cc7496d] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-05-06T14:12:20.574877+08:00 2024-05-06 14:12:21.401 INFO 17654 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 95352, operation:EXECUTE, state: RUNNING 2024-05-06 14:12:21.455 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,5576004f62b1] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=95352, context=Context{parallelIdx=-1, stringMap={task_instance_id=98911, task_operation=execute, latest_execution_start_time=2024-05-06T14:12:21.393+08:00, sub_task_instance_name=Collect compaction for all clusters, sub_task_instance_id=95352}, listMap={}}, executor=172.17.0.1 2024-05-06 14:12:21.457 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,5576004f62b1] c.o.o.s.t.b.c.AbstractAllClusterTask : Collect compaction for all clusters executed completed, tryCount=1, successCount=0 2024-05-06 14:12:21.457 INFO 17654 --- [ForkJoinPool-94251-worker-9,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2024-05-06 14:12:21.467 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,5576004f62b1] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 95352, operation:EXECUTE, state: SUCCESSFUL 2024-05-06 14:12:21.475 WARN 17654 --- [pool-ocp-async-1,a22f061523cd4629,889fce9b8697] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:21.972 INFO 17654 --- [pool-ocp-async-6,5bb2f076fd024a25,455fdf86f9e9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:22.157 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 172.17.0.1:8080 refreshes policies... 2024-05-06 14:12:22.158 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-05-06 14:12:22.343 INFO 17654 --- [pool-ocp-async-7,ea1173a1c9474834,330064073516] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-05-06 14:12:22.482 INFO 17654 --- [pool-task-coordinator2,36cdba5d54dc4768,16537d8c4d64] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:98911, status:SUCCESS 2024-05-06 14:12:22.509 INFO 17654 --- [pool-task-coordinator2,36cdba5d54dc4768,16537d8c4d64] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:98911, status:SUCCESS 2024-05-06 14:12:22.886 INFO 17654 --- [pool-prometheus-cache-monitor1,b4f56226fa5440b5,da83de33782f] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":5656,"minuteWriteQueue":0,"minuteReadCacheSize":2324,"secondWriteCacheSize":897,"seriesIdKeySize":2385,"secondWriteQueue":0,"minuteWriteCacheSize":2324} 2024-05-06 14:12:22.886 INFO 17654 --- [pool-prometheus-cache-monitor1,b4f56226fa5440b5,da83de33782f] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sysstat_40012=17, ob_server_resource_memory_assigned_bytes=6, ob_sysstat_40011=17, node_memory_sreclaimable_bytes=10, ob_sysstat_40010=17, ob_unit_num=6, tcp_retrans=9, ob_database_disk_required_size=38, go_memstats_mspan_sys_bytes=8, go_memstats_stack_sys_bytes=8, exporter_export_metrics_bytes_total=18, node_filesystem_size_bytes=43, http_server_requests_seconds_count=121, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=3, ob_compaction_frozen_time=16, ob_system_event_total_waits=22, monagent_input_sql_duration_seconds_sum=53, ob_tenant_disk_v4_log_disk_size=16, log_stream_degraded_count=16, ob_sysstat_40019=17, ob_sysstat_40018=17, processor_process_metrics_total=13, ob_plan_cache_hit_total=16, jvm_gc_max_data_size_bytes=3, node_filesystem_readonly=41, go_memstats_frees_total=8, io_await=31, host_available=7, go_memstats_mallocs_total=8, ob_unit_config_max_memory_bytes=21, ob_database_disk_data_size=37, io_util=31, ob_sysstat_200002=17, ob_sysstat_200001=17, ob_tenant_memstore_freeze_cnt=14, ob_tenant_disk_v4_data_size=16, ob_tenant_unit_min_memory=22, ob_sysstat_60087=17, ob_memstore_total_bytes=24, metric_cardinality_count=13, jvm_threads_states_threads=8, process_resident_memory_bytes=8, ob_cache_size_bytes=31, ob_tenant_assigned_cpu_total=16, ob_tenant_unit_max_memory=22, input_collect_metrics_total=13, ob_sysstat_50039=17, ob_sysstat_60083=17, ob_sysstat_50038=17, node_disk_io_time_weighted_seconds_total=18, node_disk_write_time_seconds_total=18, cpu_count=9, ob_cluster_sync=6, process_open_fds=8, ob_sysstat_50037=17, process_memory_rss_bytes=13, http_status_count=12, process_max_fds=8, ob_server_resource_cpu_assigned_percent=6, ob_sysstat_50030=17, ocp_alarm_detect_duration_ms_count=120, ob_sysstat_80057=17, go_memstats_heap_inuse_bytes=8, go_memstats_mcache_sys_bytes=8, ob_sysstat_40118=17, ob_tenant_disk_v4_log_size=16, ob_sysstat_40117=17, node_memory_memfree_bytes=10, ob_sysstat_40116=17, ob_sysstat_40005=17, process_exists=23, ob_sysstat_40004=17, ob_sysstat_40003=17, ob_sysstat_40002=17, go_gc_duration_seconds=13, ob_server_resource_disk_bytes=6, ob_sysstat_40001=17, ocp_alarm_detect_duration_ms_sum=120, ob_sysstat_40000=17, jvm_threads_live_threads=3, process_thread_count=13, ob_sysstat_50040=17, node_memory_cached_bytes=10, ob_table_num=16, ob_sysstat_40009=17, ob_disk_free_bytes=6, ob_sysstat_40008=17, node_filesystem_avail_bytes=43, ob_sysstat_40007=17, ob_sysstat_40006=17, ob_backup_storage_capacity_bytes=32, ob_sysstat_10000=17, ob_sysstat_10006=17, ob_sysstat_10005=17, ob_unit_config_max_iops=21, ob_plan_cache_memory_bytes=16, ob_sysstat_10002=17, node_network_transmit_errs_total=14, go_memstats_last_gc_time_seconds=8, ob_sysstat_10001=17, ob_sysstat_10004=17, ob_sysstat_10003=17, go_gc_duration_seconds_count=8, ocp_monitor_collect_request_duration_ms_count=7, monagent_oceanbase_plan_explain_size=1, ob_sysstat_50011=17, ob_sysstat_50010=17, monitor_exporter_avaliable=17, node_disk_read_bytes_total=18, clock_diff_milliseconds=6, ob_compaction_is_suspended=16, go_memstats_lookups_total=8, process_cpu_percent=13, log_tailer_count=8, ob_sysstat_60057=17, host_agent_process_status=11, ob_server_resource_cpu=6, go_memstats_alloc_bytes=8, ob_server_num=10, node_cpu_seconds_total_native=26, ob_sysstat_140002=17, ob_sysstat_140005=17, ob_sysstat_140006=17, ob_sysstat_140003=17, ob_tenant_resource_min_memory=16, ob_session_all_num=16, jvm_gc_pause_seconds_count=7, ob_memstore_freeze_times=24, ob_sysstat_50022=17, ob_sysstat_50021=17, jvm_gc_overhead_percent=3, ob_system_event_time_waited=22, ob_tenant_resource_min_cpu=16, ob_cluster_status_check=7, monagent_plugin_execute_seconds_total=22, jvm_memory_committed_bytes=10, node_net_bandwidth_bps=15, ob_tenant_server_data_index_data_size=17, monagent_oceanbase_db_pool_idle=1, go_memstats_heap_idle_bytes=8, go_memstats_gc_sys_bytes=8, ob_server_resource_memory_bytes=6, go_info=9, log_tailer_processed_file_count=12, ob_tenant_assigned_mem_assigned=16, node_load15=8, ob_disk_log_assigned_bytes=6, ob_tenant_memstore_minor_freeze_times=14, ob_tenant_server_required_size=17, jvm_memory_max_bytes=10, ob_unit_config_min_iops=21, ob_sysstat_30080=17, ob_sysstat_60031=17, process_fd_count=13, ob_sysstat_30082=17, ob_sysstat_30081=17, ob_tenant_unit_max_cpu=22, ob_sysstat_30084=17, ob_sysstat_30083=17, ob_sysstat_30086=17, node_memory_buffers_bytes=10, ob_sysstat_30085=17, ob_sysstat_50009=17, go_memstats_heap_released_bytes=8, ob_tenant_log_disk_total_bytes=16, node_network_receive_bytes_total=14, ob_sysstat_50005=17, ob_memstore_freeze_trigger_bytes=24, ob_sysstat_50008=17, ob_waitevent_wait_seconds_total=16, ob_server_stopped_duration_seconds=7, ob_sysstat_50001=17, ob_sysstat_50004=17, ob_sysstat_50000=17, go_memstats_next_gc_bytes=8, ob_session_active_num=16, node_filesystem_files_free=47, ob_memtable_max_snapshot_duration_seconds=12, node_disk_read_time_seconds_total=18, ob_sysstat_60021=17, ob_sysstat_60020=17, monagent_oceanbase_audit_unique_key_cache_size=1, ob_compaction_frozen_version=16, ob_sysstat_60024=17, metric_count=8, ob_sysstat_60023=17, ob_sysstat_60022=17, process_virtual_memory_bytes=8, ob_tenant_assigned_cpu_assigned=16, ob_tenant_unit_min_cpu=22, ob_unit_config_max_cpu=21, http_request_milliseconds_summary_count=36, monagent_oceanbase_audit_timeinfo_cache_size=1, ob_sysstat_20002=17, monagent_input_sql_duration_seconds_bucket=57, ob_sysstat_20001=17, node_cpu_seconds_total=16, ob_sysstat_20000=17, http_request_milliseconds_summary=39, ob_index_error_num=6, ob_tenant_memory_hold_bytes=16, ob_sysstat_30066=17, ob_log_level_count=13, go_memstats_buck_hash_sys_bytes=8, monagent_pipeline_report_metrics_total=8, ob_tenant_disk_total_size=16, node_disk_reads_completed_total=18, exporter_export_metrics_total=18, ob_disk_log_total_bytes=6, ob_sysstat_60019=17, system_cpu_count=3, process_uptime_seconds=13, ob_sysstat_130004=17, ob_sysstat_60003=17, ob_sysstat_60002=17, node_ntp_offset_seconds=9, ob_sysstat_60001=17, ob_sysstat_60000=17, go_memstats_heap_sys_bytes=8, ocp_meta_db_health=4, ob_sysstat_140012=17, ob_sysstat_140013=17, jvm_gc_pause_seconds_max=7, ob_disk_total_bytes=6, watch_ob_dir_exists=11, ob_tenant_request_queue_large_size=24, go_memstats_heap_objects=8, go_memstats_mcache_inuse_bytes=8, go_memstats_other_sys_bytes=8, ob_sysstat_130000=17, jvm_memory_used_bytes=10, ob_sysstat_130001=17, go_threads=8, ob_sysstat_130002=17, ob_sysstat_60005=17, ob_sysstat_60004=17, http_request_milliseconds_summary_sum=36, http_server_requests_seconds_sum=121, ob_memstore_active_bytes=24, go_memstats_alloc_bytes_total=8, ob_tenant_assigned_mem_total=16, process_count=14, node_memory_memtotal_bytes=10, node_network_transmit_drop_total=14, backup_storage_capacity_used_percent=6, ob_waitevent_wait_total=16, ob_tenant_log_disk_used_bytes=16, jvm_gc_memory_promoted_bytes_total=3, ob_sysstat_30011=17, ob_sysstat_30010=17, ob_sysstat_30013=17, ob_sysstat_30012=17, ob_disk_log_used_bytes=6, ob_tenant500_memory_used_bytes=6, ob_compaction_is_error=16, node_network_transmit_bytes_total=14, node_network_receive_drop_total=14, monagent_pipeline_execute_total=14, node_filesystem_files=47, process_start_time_seconds=8, ob_tenant_log_sync_delay=16, go_memstats_heap_alloc_bytes=8, ob_tenant_resource_max_cpu=16, ntp_service_available=9, go_gc_duration_seconds_sum=8, go_memstats_mspan_inuse_bytes=8, ob_server_resource_memory_assigned_percent=6, monagent_pipeline_execute_seconds_total=14, jvm_gc_pause_seconds_sum=7, ob_sysstat_80001=17, go_memstats_sys_bytes=8, node_network_receive_errs_total=14, system_load_average_1m=3, monagent_oceanbase_audit_stat_cache_size=1, observer_ulimit_max_fd_count=6, ob_tenant_memory_used_bytes=16, ob_plan_cache_access_total=16, monagent_oceanbase_plan_cache_size=1, ob_tenant_server_data_size=17, monagent_oceanbase_audit_sample_cache_size=1, ob_sysstat_80002=17, ob_sysstat_80003=17, ob_sysstat_80007=17, node_disk_writes_completed_total=18, ob_sysstat_80008=17, ob_sysstat_80009=17, ob_tenant_memstore_compact_trigger_ratio=14, ob_sysstat_40030=17, process_cpu_seconds_total=8, node_load1=8, ob_sysstat_120001=17, ob_sysstat_120002=17, ob_sysstat_120000=17, ob_tenant_resource_max_memory=16, system_cpu_usage=3, ob_sysstat_120009=17, go_memstats_stack_inuse_bytes=8, ob_sysstat_120008=17, node_load5=8, ob_sysstat_120005=17, jvm_threads_peak_threads=3, ob_sysstat_120006=17, process_cpu_usage=3, monagent_input_sql_duration_seconds_count=53, node_disk_written_bytes_total=18, monagent_oceanbase_ash_cache_size=1, monagent_pipeline_process_metrics_total=18, go_goroutines=8, ob_compaction_last_version=16, ob_sysstat_30000=17, ob_server_resource_cpu_assigned=6, ob_sysstat_30002=17, ob_unit_config_min_cpu=21, ob_sysstat_30001=17, process_virtual_memory_max_bytes=8, monagent_oceanbase_plan_timeinfo_cache_size=1, monagent_plugin_execute_total=22, ob_tenant500_memory_hold_bytes=6, ob_sysstat_30006=17, arbitration_status_inactive_server_count=6, ob_sysstat_30005=17, ob_sysstat_30008=17, ob_sysstat_30007=17, ob_sysstat_30009=17, ob_compaction_current_timestamp=16, ob_compaction_start_time=16, oceanbase_connectivity=8} 2024-05-06 14:12:23.478 WARN 17654 --- [pool-ocp-async-9,0d646107c8fb4cbe,971b17377c03] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:23.884 INFO 17654 --- [pool-prometheus-minute-schedule-1,c1f047586a1f4803,2a6be25d5090] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714975980, interval=60 2024-05-06 14:12:23.892 INFO 17654 --- [pool-prometheus-minute-schedule-1,c1f047586a1f4803,2a6be25d5090] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:23.972 INFO 17654 --- [pool-ocp-async-1,d63f7ac49b08436f,74d3dd9a7180] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:25.159 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 172.17.0.1:8080 refreshes policies... 2024-05-06 14:12:25.160 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-05-06 14:12:25.165 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,dc02c3715d6c4aec,a890218adeb4] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/backup/task/dataBackupTasks?page=1&size=10, client=192.168.0.57, traceId=dc02c3715d6c4aec, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObBackupController.listDataBackupTasks(OffsetDateTime,OffsetDateTime,String,List,Long,Long,Pageable), args=Page request [number: 0, size 10, sort: startTime: DESC],] 2024-05-06 14:12:25.165 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,326d223d28e84e01,598c2a686062] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?foldStandby=false, client=192.168.0.57, traceId=326d223d28e84e01, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObClusterController.listObClusters(String,List,boolean,Boolean,WithRemote,List,Pageable), args=false,NONE,Page request [number: 0, size 2000, sort: name: ASC,obClusterId: ASC],] 2024-05-06 14:12:25.184 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,326d223d28e84e01,598c2a686062] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.0.57, traceId=326d223d28e84e01, duration=25 ms] 2024-05-06 14:12:25.301 INFO 17654 --- [backup-common-executor-27,dc02c3715d6c4aec,3e98c1a0e95b] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=weixiaoOBD, obClusterId=1714450365, tenantName=sys, username=root, address=127.0.0.1, port=2881, database=oceanbase) 2024-05-06 14:12:25.302 INFO 17654 --- [backup-common-executor-27,dc02c3715d6c4aec,3e98c1a0e95b] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=direct, address=null, port=null, obsAddrList=[ObServerAddr(address=127.0.0.1, port=2881)], username=root, tenantName=sys, clusterName=weixiaoOBD, obClusterId=1714450365, proxy=null, odpSocketConfig=null, vpcId=1, compatibilityMode=MYSQL, database=oceanbase) 2024-05-06 14:12:25.343 INFO 17654 --- [obsdk-init-thread-4,dc02c3715d6c4aec,0cef36986e17] com.alibaba.druid.pool.DruidDataSource : {dataSource-24,ob-connector-datasource_direct_sys_root_127.0.0.1_2881} inited 2024-05-06 14:12:25.343 INFO 17654 --- [obsdk-init-thread-4,dc02c3715d6c4aec,0cef36986e17] c.o.o.o.c.impl.AbstractConnector : [obsdk] init druid datasource success, poolingCount=1, connectProperties=ConnectProperties(connectionMode=direct, address=127.0.0.1, port=2881, obsAddrList=[ObServerAddr(address=127.0.0.1, port=2881)], username=root, tenantName=sys, clusterName=weixiaoOBD, obClusterId=1714450365, proxy=null, odpSocketConfig=null, vpcId=1, compatibilityMode=MYSQL, database=oceanbase) 2024-05-06 14:12:25.344 INFO 17654 --- [backup-common-executor-27,dc02c3715d6c4aec,3e98c1a0e95b] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] create new ob connector success 2024-05-06 14:12:25.344 INFO 17654 --- [backup-common-executor-27,dc02c3715d6c4aec,3e98c1a0e95b] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:25.350 INFO 17654 --- [backup-common-executor-27,dc02c3715d6c4aec,3e98c1a0e95b] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:25.350 INFO 17654 --- [backup-common-executor-27,dc02c3715d6c4aec,3e98c1a0e95b] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:25.351 INFO 17654 --- [backup-common-executor-27,dc02c3715d6c4aec,3e98c1a0e95b] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id WHERE tenant_id != 1 ORDER BY start_time DESC) 2024-05-06 14:12:25.424 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,dc02c3715d6c4aec,a890218adeb4] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/backup/task/dataBackupTasks client=192.168.0.57, traceId=dc02c3715d6c4aec, duration=265 ms] 2024-05-06 14:12:25.477 WARN 17654 --- [pool-ocp-async-5,61b21e251bf64b02,7da9bad41cc2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:25.973 INFO 17654 --- [pool-ocp-async-10,45c58ca4e60c4cde,ecfe934c3e67] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:26.884 INFO 17654 --- [pool-prometheus-minute-schedule-1,7b16a4414be3496d,b16295b92c7c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714975980, interval=60 2024-05-06 14:12:26.890 INFO 17654 --- [pool-prometheus-minute-schedule-1,7b16a4414be3496d,b16295b92c7c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:26.998 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,ef3cc36a611a40e2,ef07466a8b9b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?foldStandby=false, client=192.168.0.57, traceId=ef3cc36a611a40e2, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObClusterController.listObClusters(String,List,boolean,Boolean,WithRemote,List,Pageable), args=false,NONE,Page request [number: 0, size 2000, sort: name: ASC,obClusterId: ASC],] 2024-05-06 14:12:27.014 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,4810dc3ed186433d,c68a882c44f1] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/backup/task/restoreTasks?page=1&size=10, client=192.168.0.57, traceId=4810dc3ed186433d, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObBackupController.listRestoreTasks(OffsetDateTime,OffsetDateTime,List,List,List,Pageable), args=Page request [number: 0, size 10, sort: createTime: DESC],] 2024-05-06 14:12:27.015 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,ef3cc36a611a40e2,ef07466a8b9b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.0.57, traceId=ef3cc36a611a40e2, duration=23 ms] 2024-05-06 14:12:27.064 INFO 17654 --- [backup-common-executor-28,4810dc3ed186433d,1119fe299ae9] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:27.072 INFO 17654 --- [backup-common-executor-28,4810dc3ed186433d,1119fe299ae9] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:27.072 INFO 17654 --- [backup-common-executor-28,4810dc3ed186433d,1119fe299ae9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:27.073 INFO 17654 --- [backup-common-executor-28,4810dc3ed186433d,1119fe299ae9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, backup_cluster_name, backup_tenant_name, backup_tenant_id, backup_dest, restore_tenant_name, restore_tenant_id, restore_option, restore_scn_display AS restore_finish_timestamp, start_timestamp AS start_time, finish_timestamp AS completion_time, status, comment AS error_msg, description FROM ( SELECT job_id, tenant_id, backup_cluster_name, backup_tenant_name, backup_tenant_id, backup_dest, restore_tenant_name, restore_tenant_id, restore_option, restore_scn_display, start_timestamp, NULL AS finish_timestamp, status, NULL AS comment, description FROM CDB_OB_RESTORE_PROGRESS UNION SELECT job_id, tenant_id, backup_cluster_name, backup_tenant_name, backup_tenant_id, backup_dest, restore_tenant_name, restore_tenant_id, restore_option, restore_scn_display, start_timestamp, finish_timestamp, status, comment, description FROM CDB_OB_RESTORE_HISTORY ) RIGHT JOIN (SELECT job_id AS _job_id, max(tenant_id) as _tenant_id FROM ( SELECT job_id, tenant_id FROM CDB_OB_RESTORE_PROGRESS UNION SELECT job_id, tenant_id FROM CDB_OB_RESTORE_HISTORY ) GROUP BY _job_id ) AS t ON job_id = t._job_id AND tenant_id = t._tenant_id ORDER BY start_time DESC) 2024-05-06 14:12:27.130 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,4810dc3ed186433d,c68a882c44f1] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/backup/task/restoreTasks client=192.168.0.57, traceId=4810dc3ed186433d, duration=121 ms] 2024-05-06 14:12:27.478 WARN 17654 --- [pool-ocp-async-7,5f353f7a38b14da5,a44b29a0b347] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:27.973 INFO 17654 --- [pool-ocp-async-6,d7e15e1f4ec4445e,9cc9277b199c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:28.073 INFO 17654 --- [pool-ocp-schedules-8,c6263869701e4f07,a335de58e33a] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-05-06 14:12:28.160 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 172.17.0.1:8080 refreshes policies... 2024-05-06 14:12:28.162 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-05-06 14:12:28.972 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-7,bd51bc938daa4788,d827c91f25e8] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/backup/services?null, client=192.168.0.57, traceId=bd51bc938daa4788, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObBackupController.listBackupRestoreServices(List,List), args=] 2024-05-06 14:12:28.972 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-9,d8a6ceee8cb04577,8cb10767184f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/backup/config/storages?null, client=192.168.0.57, traceId=d8a6ceee8cb04577, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObBackupController.getAvailableStorageConfigList(Long,BackupStorageType), args=] 2024-05-06 14:12:28.976 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-7,bd51bc938daa4788,d827c91f25e8] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/backup/services client=192.168.0.57, traceId=bd51bc938daa4788, duration=8 ms] 2024-05-06 14:12:28.976 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-9,d8a6ceee8cb04577,8cb10767184f] c.o.o.b.i.u.BackupParamSecurityUtils : storage[BACKUP_STORAGE_FILE] not need desensitize accessKey. 2024-05-06 14:12:28.976 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-9,d8a6ceee8cb04577,8cb10767184f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/backup/config/storages client=192.168.0.57, traceId=d8a6ceee8cb04577, duration=9 ms] 2024-05-06 14:12:28.976 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,0ca9e8a1b0784775,964576158738] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/backup/clusters?backupStatus=HAS_BACKUP_STRATEGY&backupStatus=NO_BACKUP_STRATEGY, client=192.168.0.57, traceId=0ca9e8a1b0784775, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObBackupController.listObClusters(List), args=[HAS_BACKUP_STRATEGY, NO_BACKUP_STRATEGY],] 2024-05-06 14:12:28.976 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-1,aa71c909e2684513,dcf2170e6b55] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/hosts?includedServiceType=OB_CLUSTER&includedServiceType=BACKUP_AGENT&includedServiceType=RESTORE_AGENT&includedServiceType=BACKUP_RESTORE_AGENT, client=192.168.0.57, traceId=aa71c909e2684513, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listHosts(List,String,List,List,List,List,List,Pageable), args=[OB_CLUSTER, BACKUP_AGENT, RESTORE_AGENT, BACKUP_RESTORE_AGENT],Page request [number: 0, size 2000, sort: id: DESC],] 2024-05-06 14:12:28.985 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-1,aa71c909e2684513,dcf2170e6b55] o.h.h.internal.ast.QueryTranslatorImpl : HHH000104: firstResult/maxResults specified with collection fetch; applying in memory! 2024-05-06 14:12:29.004 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,0ca9e8a1b0784775,964576158738] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/backup/clusters client=192.168.0.57, traceId=0ca9e8a1b0784775, duration=33 ms] 2024-05-06 14:12:29.033 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-1,aa71c909e2684513,dcf2170e6b55] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hosts client=192.168.0.57, traceId=aa71c909e2684513, duration=63 ms] 2024-05-06 14:12:29.305 INFO 17654 --- [pool-ocp-schedules-3,910c4f23cd56440a,1bfaf7d225ad] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-05-06 14:12:29.324 INFO 17654 --- [pool-ocp-schedules-3,910c4f23cd56440a,1bfaf7d225ad] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[14042fae-d248-4b59-871d-9663e4519504] 2024-05-06 14:12:29.324 INFO 17654 --- [pool-ocp-schedules-3,910c4f23cd56440a,1bfaf7d225ad] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[14042fae-d248-4b59-871d-9663e4519504] 2024-05-06 14:12:29.478 WARN 17654 --- [pool-ocp-async-10,72dac9b0bc134a3a,ec78542c0c0d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:29.884 INFO 17654 --- [pool-prometheus-minute-schedule-1,0b853238a5b9432c,2dca9359efc9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714975980, interval=60 2024-05-06 14:12:29.892 INFO 17654 --- [pool-prometheus-minute-schedule-1,0b853238a5b9432c,2dca9359efc9] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:29.973 INFO 17654 --- [pool-ocp-async-3,031df250cb1d4875,27a4c86d416d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:30.102 INFO 17654 --- [pool-prometheus-second-schedule-1,659aacf6dafc495a,336649c5bbeb] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:30.260 INFO 17654 --- [pool-ocp-async-10,05ae07338a264078,297567c992f4] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-05-06 14:12:30.285 WARN 17654 --- [pool-scanner-115275083-1,05ae07338a264078,b09593462e07] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 6 2024-05-06 14:12:30.390 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-05-06 14:11:31.0, nextRun=2024-05-06 14:12:30.0, currentDate=Mon May 06 14:12:30 CST 2024 2024-05-06 14:12:30.390 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999990, name=Sync tenant information, templateName=TenantSyncSchedule, scheduleRule=30 0/1 * * * ?, lastRunTime=2024-05-06 14:11:31.0, nextRunTime=2024-05-06 14:12:30.0} 2024-05-06 14:12:30.399 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Sync tenant information, nodeCount=1, taskCount=1 2024-05-06 14:12:30.399 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.m.r.t.m.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2024-05-06 14:12:30.399 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Sync tenant information', taskDefinitionId=999990, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='172.17.0.1', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={cluster_ids=[1]}}, createTime=null, startTime=2024-05-06T14:12:30.399+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Sync all tenant information, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.tenant.SyncAllTenantInfoTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='e6731b8a02884b1b', operation=EXECUTE} 2024-05-06 14:12:30.478 INFO 17654 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 95353, operation:EXECUTE, state: RUNNING 2024-05-06 14:12:30.518 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=95353, context=Context{parallelIdx=0, stringMap={subtask_splitter=cluster_ids, task_instance_id=98912, task_operation=execute, latest_execution_start_time=2024-05-06T14:12:30.474+08:00, sub_task_instance_name=Sync all tenant information, sub_task_instance_id=95353}, listMap={cluster_ids=[1]}}, executor=172.17.0.1 2024-05-06 14:12:30.539 INFO 17654 --- [alarm-task-1,9d1cb1ba51044be6,9a487cc7496d] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-05-06T14:12:30.538919+08:00, lastProcessTime=2024-05-06T14:12:20.574877+08:00 2024-05-06 14:12:30.588 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.593 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2024-05-06 14:12:30.594 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.594 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.595 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2024-05-06 14:12:30.615 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.615 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.616 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2024-05-06 14:12:30.641 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.642 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.643 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2024-05-06 14:12:30.668 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.668 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.669 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2024-05-06 14:12:30.694 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.694 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.695 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2024-05-06 14:12:30.719 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.719 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.720 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2024-05-06 14:12:30.748 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.748 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.748 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2024-05-06 14:12:30.771 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.772 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.772 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1006] 2024-05-06 14:12:30.802 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.802 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.803 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1006] 2024-05-06 14:12:30.818 INFO 17654 --- [alarm-task-1,9d1cb1ba51044be6,9a487cc7496d] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-05-06T14:12:30.538919+08:00 2024-05-06 14:12:30.833 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.833 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.833 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1008] 2024-05-06 14:12:30.858 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.858 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.858 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1008] 2024-05-06 14:12:30.915 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:30.916 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.922 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.922 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.923 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2024-05-06 14:12:30.939 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:30.940 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.941 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.941 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.942 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2024-05-06 14:12:30.957 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:30.958 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.959 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.959 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.960 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2024-05-06 14:12:30.988 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:30.989 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.989 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:30.989 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:30.990 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2024-05-06 14:12:31.006 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:31.007 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.007 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.007 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.008 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2024-05-06 14:12:31.023 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:31.024 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.024 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.024 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.025 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2024-05-06 14:12:31.053 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:31.054 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.055 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.055 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.055 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2024-05-06 14:12:31.070 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:31.071 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.072 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.072 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.072 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2024-05-06 14:12:31.088 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:31.088 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.089 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.089 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.090 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2024-05-06 14:12:31.118 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:31.119 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.119 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.119 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.120 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1006, ALTER_TENANT_LOCALITY] 2024-05-06 14:12:31.136 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:31.136 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.137 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.137 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.138 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1006, SHRINK_RESOURCE_POOL_UNIT_NUM] 2024-05-06 14:12:31.152 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:31.153 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.154 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.154 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.155 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1006, ALTER_RESOURCE_TENANT_UNIT_NUM] 2024-05-06 14:12:31.162 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 172.17.0.1:8080 refreshes policies... 2024-05-06 14:12:31.163 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-05-06 14:12:31.184 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:31.185 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.185 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.185 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.186 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1008, ALTER_TENANT_LOCALITY] 2024-05-06 14:12:31.207 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:31.208 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.209 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.209 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.209 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1008, SHRINK_RESOURCE_POOL_UNIT_NUM] 2024-05-06 14:12:31.229 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:31.230 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.230 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.231 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.231 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1008, ALTER_RESOURCE_TENANT_UNIT_NUM] 2024-05-06 14:12:31.232 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2024-05-06 14:12:31.249 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=172.17.0.1 2024-05-06 14:12:31.278 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:31.279 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.282 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.282 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.282 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2024-05-06 14:12:31.307 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,172.17.0.1, userWhitelist=% 2024-05-06 14:12:31.315 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2024-05-06 14:12:31.315 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.316 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.316 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2024-05-06 14:12:31.343 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,172.17.0.1, userWhitelist=% 2024-05-06 14:12:31.347 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2024-05-06 14:12:31.347 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.348 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.348 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1006] 2024-05-06 14:12:31.370 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=4, realWhitelist=%, defaultWhitelist=127.0.0.1,172.17.0.1, userWhitelist=% 2024-05-06 14:12:31.374 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=4, userWhitelist=% 2024-05-06 14:12:31.375 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.375 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.376 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2024-05-06 14:12:31.398 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,172.17.0.1, userWhitelist=% 2024-05-06 14:12:31.403 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2024-05-06 14:12:31.403 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:31.404 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:31.404 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1008] 2024-05-06 14:12:31.426 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=5, realWhitelist=%, defaultWhitelist=127.0.0.1,172.17.0.1, userWhitelist=% 2024-05-06 14:12:31.430 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=5, userWhitelist=% 2024-05-06 14:12:31.431 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2024-05-06 14:12:31.431 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.s.t.b.t.SyncAllTenantInfoTask : [OCP606] sync tenants success, clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365 2024-05-06 14:12:31.442 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,e7d35f50ec67] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 95353, operation:EXECUTE, state: SUCCESSFUL 2024-05-06 14:12:31.477 WARN 17654 --- [pool-ocp-async-6,cb81416407934809,77700c09cd92] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:31.973 INFO 17654 --- [pool-ocp-async-10,8878a563a94f4112,e48df605c6ce] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:31.985 INFO 17654 --- [pool-task-coordinator2,36cdba5d54dc4768,16537d8c4d64] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:98912, status:SUCCESS 2024-05-06 14:12:31.987 INFO 17654 --- [pool-task-coordinator2,36cdba5d54dc4768,16537d8c4d64] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:98912, status:SUCCESS 2024-05-06 14:12:32.343 INFO 17654 --- [pool-ocp-async-8,d781a00cac1b418c,84f1939d0056] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-05-06 14:12:32.698 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.s.c.c.s.utils.CsrfRequestMatcher : CSRF token required for API [POST /api/v2/backup/info, client 192.168.0.57, traceId 5ff478b3ab014ab8] 2024-05-06 14:12:32.700 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /api/v2/backup/info?timeScopeType=LATEST_SEVEN_DAYS, client=192.168.0.57, traceId=5ff478b3ab014ab8, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObBackupController.parseObBackupInfo(ParseObBackupInfoParam,OffsetDateTime,OffsetDateTime,ObQueryTimeScopeType), args=ParseObBackupInfoParam(obBackupStorageBaseInfo=ObBackupStorageBaseInfo(backupStorageType=BACKUP_STORAGE_FILE, storageUrl=/obbackup/, ossAccessKey=null, cosAccessKey=null, obsAccessKey=null), hostIdList=[1], storageId=null),LATEST_SEVEN_DAYS,] 2024-05-06 14:12:32.700 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.b.i.u.BackupParamSecurityUtils : storage[BACKUP_STORAGE_FILE] not need decrypt param 2024-05-06 14:12:32.700 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.oceanbase.backup.core.model.TimeScope : normalize time scope (startTime=null, endTime=null): invalid, default to latest seven days time scope 2024-05-06 14:12:32.762 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:32.770 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:32.884 INFO 17654 --- [pool-prometheus-minute-schedule-1,9de72bca45a74325,6d88bcab7dcf] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714975980, interval=60 2024-05-06 14:12:32.891 INFO 17654 --- [pool-prometheus-minute-schedule-1,9de72bca45a74325,6d88bcab7dcf] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:32.915 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/exists, request body:CheckBackupFileExistsRequest(path=/obbackup/), params:null 2024-05-06 14:12:32.922 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:32.925 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:32.939 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/find, request body:FindBackupFileRequest(path=/obbackup/, recursive=false), params:null 2024-05-06 14:12:32.949 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:32.951 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:32.968 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/exists, request body:CheckBackupFileExistsRequest(path=/obbackup/weixiaoOBD), params:null 2024-05-06 14:12:32.973 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:32.976 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:32.991 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/find, request body:FindBackupFileRequest(path=/obbackup/weixiaoOBD, recursive=false), params:null 2024-05-06 14:12:33.001 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:33.004 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:33.019 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/exists, request body:CheckBackupFileExistsRequest(path=/obbackup/weixiaoOBD), params:null 2024-05-06 14:12:33.023 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:33.026 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:33.040 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/find, request body:FindBackupFileRequest(path=/obbackup/weixiaoOBD, recursive=false), params:null 2024-05-06 14:12:33.051 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:33.053 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:33.069 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/exists, request body:CheckBackupFileExistsRequest(path=/obbackup/weixiaoOBD/1714450365), params:null 2024-05-06 14:12:33.074 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:33.077 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:33.092 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/find, request body:FindBackupFileRequest(path=/obbackup/weixiaoOBD/1714450365, recursive=false), params:null 2024-05-06 14:12:33.098 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.b.i.f.p.ProxyBackupServiceImpl : parse backup cluster list=[BackupFileClusterInfo(backupFileMode=PHYSICAL, rootUri=/obbackup, clusterName=weixiaoOBD, obClusterId=1714450365)] 2024-05-06 14:12:33.098 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.b.i.f.p.ProxyBackupServiceImpl : clusterInfoList=[BackupFileClusterInfo(backupFileMode=PHYSICAL, rootUri=/obbackup, clusterName=weixiaoOBD, obClusterId=1714450365)], logicalClusterInfoList=[], physicalClusterInfoList=[BackupFileClusterInfo(backupFileMode=PHYSICAL, rootUri=/obbackup, clusterName=weixiaoOBD, obClusterId=1714450365)], mixedClusterInfoList=[] 2024-05-06 14:12:33.107 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:33.109 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:33.125 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/dumpPhysicalCheck, request body:DumpPhysicalBackupFileRequest(obPath=ObPath(installPath=/mnt/weixiaoOBD/oceanbase, dataPath=/mnt/weixiaoOBD/oceanbase/store, logPath=/mnt/weixiaoOBD/oceanbase/store, diskPathStyle=OBD, runPath=/mnt/weixiaoOBD/oceanbase), backupFilePath=file:///obbackup/weixiaoOBD/1714450365/incarnation_1, storageOption=), params:null 2024-05-06 14:12:33.137 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] .b.i.d.f.p.PhysicalBackupFileCheckDumper : try dump backup file failed, hostId=1, backupFilePath=file:///obbackup/weixiaoOBD/1714450365/incarnation_1 com.oceanbase.ocp.executor.exception.HttpRequestFailedException: [AgentClient]:http request is failed, response:Execute shell command failed: failed to execute command: Command{user=admin, program=sh, outputType=combined, cmd=export LD_LIBRARY_PATH=/mnt/weixiaoOBD/oceanbase/lib:$LD_LIBRARY_PATH && /mnt/weixiaoOBD/oceanbase/bin/ob_admin dump_backup -q -c -d file:///obbackup/weixiaoOBD/1714450365/incarnation_1 2>&1, timeout=10s}, exitCode: 1, output: sudo: unknown user admin sudo: error initializing audit plugin sudoers_audit , error: exit status 1 at com.oceanbase.ocp.executor.internal.template.HttpTemplate.checkSuccess(HttpTemplate.java:476) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.doPost(HttpTemplate.java:286) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.post(HttpTemplate.java:114) at com.oceanbase.ocp.executor.executor.AgentExecutor.dumpPhysicalBackupFileCheck(AgentExecutor.java:637) at com.oceanbase.ocp.backup.internal.agent.BackupHostOperationService.dumpBackupFileCheck(BackupHostOperationService.java:180) at com.oceanbase.ocp.backup.internal.data.file.physical.PhysicalBackupFileCheckDumper.dumpCheckFileResult(PhysicalBackupFileCheckDumper.java:46) at com.oceanbase.ocp.backup.internal.data.file.physical.PhysicalFileUnifiedChecker.doesFileExist(PhysicalFileUnifiedChecker.java:42) at com.oceanbase.ocp.backup.internal.data.file.physical.PhysicalBackupFileManager.fileExists(PhysicalBackupFileManager.java:57) at com.oceanbase.ocp.backup.internal.BackupInfoManagerFactory.getPhysicalBackupInfoManager(BackupInfoManagerFactory.java:75) at com.oceanbase.ocp.backup.internal.facadeimpl.physical.PhysicalBackupServiceImpl.parseObClusterBackupInfo(PhysicalBackupServiceImpl.java:724) at com.oceanbase.ocp.backup.internal.facadeimpl.physical.PhysicalBackupServiceImpl.parseObBackupInfo(PhysicalBackupServiceImpl.java:711) at com.oceanbase.ocp.backup.internal.facadeimpl.proxy.ProxyBackupServiceImpl.parseObBackupInfo(ProxyBackupServiceImpl.java:795) at com.oceanbase.ocp.backup.internal.facadeimpl.proxy.ProxyBackupServiceImpl.parseObBackupInfo(ProxyBackupServiceImpl.java:766) at com.oceanbase.ocp.server.common.controller.ObBackupController.parseObBackupInfo(ObBackupController.java:683) at com.oceanbase.ocp.server.common.controller.ObBackupController$$FastClassBySpringCGLIB$$5f20ca8d.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor420.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:61) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controller.ObBackupController$$EnhancerBySpringCGLIB$$dcd1183f.parseObBackupInfo() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) at javax.servlet.http.HttpServlet.service(HttpServlet.java:528) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:132) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) 2024-05-06 14:12:33.137 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] .b.i.d.f.p.PhysicalBackupFileCheckDumper : try dump backup file all failed, hostIdList=[1], backupFilePath=file:///obbackup/weixiaoOBD/1714450365/incarnation_1 2024-05-06 14:12:33.138 ERROR 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.b.i.BackupInfoManagerFactory : catch exception caused by [OCP UnexpectedException]: status=500 INTERNAL_SERVER_ERROR, errorCode=BACKUP_FILE_DUMP_FILE_ERROR, args=[1],file:///obbackup/weixiaoOBD/1714450365/incarnation_1 com.oceanbase.ocp.core.exception.UnexpectedException: [OCP UnexpectedException]: status=500 INTERNAL_SERVER_ERROR, errorCode=BACKUP_FILE_DUMP_FILE_ERROR, args=[1],file:///obbackup/weixiaoOBD/1714450365/incarnation_1 at com.oceanbase.ocp.backup.internal.data.file.physical.PhysicalBackupFileCheckDumper.dumpCheckFileResult(PhysicalBackupFileCheckDumper.java:52) at com.oceanbase.ocp.backup.internal.data.file.physical.PhysicalFileUnifiedChecker.doesFileExist(PhysicalFileUnifiedChecker.java:42) at com.oceanbase.ocp.backup.internal.data.file.physical.PhysicalBackupFileManager.fileExists(PhysicalBackupFileManager.java:57) at com.oceanbase.ocp.backup.internal.BackupInfoManagerFactory.getPhysicalBackupInfoManager(BackupInfoManagerFactory.java:75) at com.oceanbase.ocp.backup.internal.facadeimpl.physical.PhysicalBackupServiceImpl.parseObClusterBackupInfo(PhysicalBackupServiceImpl.java:724) at com.oceanbase.ocp.backup.internal.facadeimpl.physical.PhysicalBackupServiceImpl.parseObBackupInfo(PhysicalBackupServiceImpl.java:711) at com.oceanbase.ocp.backup.internal.facadeimpl.proxy.ProxyBackupServiceImpl.parseObBackupInfo(ProxyBackupServiceImpl.java:795) at com.oceanbase.ocp.backup.internal.facadeimpl.proxy.ProxyBackupServiceImpl.parseObBackupInfo(ProxyBackupServiceImpl.java:766) at com.oceanbase.ocp.server.common.controller.ObBackupController.parseObBackupInfo(ObBackupController.java:683) at com.oceanbase.ocp.server.common.controller.ObBackupController$$FastClassBySpringCGLIB$$5f20ca8d.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor420.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:61) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controller.ObBackupController$$EnhancerBySpringCGLIB$$dcd1183f.parseObBackupInfo() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) at javax.servlet.http.HttpServlet.service(HttpServlet.java:528) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:132) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) 2024-05-06 14:12:33.139 ERROR 17654 --- [http-nio-0.0.0.0-8080-exec-8,5ff478b3ab014ab8,990771921927] c.o.o.s.c.trace.RequestTracingAspect : Unexpected API Error: [POST /api/v2/backup/info client=192.168.0.57, traceId=5ff478b3ab014ab8, args=ParseObBackupInfoParam(obBackupStorageBaseInfo=ObBackupStorageBaseInfo(backupStorageType=BACKUP_STORAGE_FILE, storageUrl=/obbackup/, ossAccessKey=null, cosAccessKey=null, obsAccessKey=null), hostIdList=[1], storageId=null),LATEST_SEVEN_DAYS,, duration=445 ms] com.oceanbase.ocp.core.exception.UnexpectedException: [OCP UnexpectedException]: status=500 INTERNAL_SERVER_ERROR, errorCode=BACKUP_PARSER_CHECK_PHYSICAL_FILE_EXIST_ERROR, args=file:///obbackup/weixiaoOBD/1714450365/incarnation_1 at com.oceanbase.ocp.backup.internal.BackupInfoManagerFactory.getPhysicalBackupInfoManager(BackupInfoManagerFactory.java:83) at com.oceanbase.ocp.backup.internal.facadeimpl.physical.PhysicalBackupServiceImpl.parseObClusterBackupInfo(PhysicalBackupServiceImpl.java:724) at com.oceanbase.ocp.backup.internal.facadeimpl.physical.PhysicalBackupServiceImpl.parseObBackupInfo(PhysicalBackupServiceImpl.java:711) at com.oceanbase.ocp.backup.internal.facadeimpl.proxy.ProxyBackupServiceImpl.parseObBackupInfo(ProxyBackupServiceImpl.java:795) at com.oceanbase.ocp.backup.internal.facadeimpl.proxy.ProxyBackupServiceImpl.parseObBackupInfo(ProxyBackupServiceImpl.java:766) at com.oceanbase.ocp.server.common.controller.ObBackupController.parseObBackupInfo(ObBackupController.java:683) at com.oceanbase.ocp.server.common.controller.ObBackupController$$FastClassBySpringCGLIB$$5f20ca8d.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor420.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:61) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controller.ObBackupController$$EnhancerBySpringCGLIB$$dcd1183f.parseObBackupInfo() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) at javax.servlet.http.HttpServlet.service(HttpServlet.java:528) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:132) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) 2024-05-06 14:12:33.480 WARN 17654 --- [pool-ocp-async-1,06d22d1c46954d6f,4b0ecabcad60] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:33.974 INFO 17654 --- [pool-ocp-async-6,ebbabb85e0534ae8,b8803fc9eddc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:34.163 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 172.17.0.1:8080 refreshes policies... 2024-05-06 14:12:34.165 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-05-06 14:12:35.477 WARN 17654 --- [pool-ocp-async-9,ae76a48a21de402f,995756640bf6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:35.884 INFO 17654 --- [pool-prometheus-minute-schedule-1,140014a410c04a17,8c22dfc16c02] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714975980, interval=60 2024-05-06 14:12:35.890 INFO 17654 --- [pool-prometheus-minute-schedule-1,140014a410c04a17,8c22dfc16c02] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:35.974 INFO 17654 --- [pool-ocp-async-7,45fc47dc458840f2,78a86e5b856f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:37.165 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 172.17.0.1:8080 refreshes policies... 2024-05-06 14:12:37.166 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-05-06 14:12:37.479 WARN 17654 --- [pool-ocp-async-6,75b0424dacfe4141,f056ad93f027] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:37.974 INFO 17654 --- [pool-ocp-async-10,734abab54b684075,e824b86901d4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:38.079 INFO 17654 --- [pool-ocp-schedules-14,e71586943fc047a9,f2ed35f71a01] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-05-06 14:12:38.884 INFO 17654 --- [pool-prometheus-minute-schedule-1,a93cd023100244d6,697bfc179db3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714975980, interval=60 2024-05-06 14:12:38.892 INFO 17654 --- [pool-prometheus-minute-schedule-1,a93cd023100244d6,697bfc179db3] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:39.479 WARN 17654 --- [pool-ocp-async-7,5e9a7867f4a44e00,f7a2fefcfb5a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:39.974 INFO 17654 --- [pool-ocp-async-4,2f6410b43b084c2a,ac5407fef1ef] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:40.031 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-05-06 14:12:11.0, nextRun=2024-05-06 14:12:40.0, currentDate=Mon May 06 14:12:40 CST 2024 2024-05-06 14:12:40.032 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999997, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=10/30 * * * * *, lastRunTime=2024-05-06 14:12:11.0, nextRunTime=2024-05-06 14:12:40.0} 2024-05-06 14:12:40.036 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2024-05-06 14:12:40.036 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.m.r.t.m.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2024-05-06 14:12:40.036 INFO 17654 --- [pool-task-coordinator1,e6731b8a02884b1b,987a4c48060f] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Check obproxy', taskDefinitionId=999997, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='172.17.0.1', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2024-05-06T14:12:40.036+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Check obproxy connection status, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='e6731b8a02884b1b', operation=EXECUTE} 2024-05-06 14:12:40.166 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 172.17.0.1:8080 refreshes policies... 2024-05-06 14:12:40.168 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-05-06 14:12:40.258 INFO 17654 --- [pool-ocp-schedules-7,f3410a172f44424e,f1fe1e454ead] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-05-06 14:12:40.260 INFO 17654 --- [pool-ocp-async-1,847973b863bf4872,e53cfa61a444] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-05-06 14:12:40.272 WARN 17654 --- [pool-scanner-115275207-1,847973b863bf4872,d9b1195fa0bb] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 6 2024-05-06 14:12:40.280 INFO 17654 --- [pool-ocp-schedules-7,f3410a172f44424e,f1fe1e454ead] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-05-06 14:12:40.283 INFO 17654 --- [pool-ocp-schedules-2,7e345d25cd674726,98056af9365a] c.o.o.s.task.scheduled.ClusterSchedules : Check all arbitration services 2024-05-06 14:12:40.284 INFO 17654 --- [pool-ocp-async-10,a401b27ff6cb403f,ce50ba3b64e4] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-05-06 14:12:40.284 INFO 17654 --- [pool-ocp-schedules-5,410ec6eadd3b4673,ba1e192ba69e] c.o.o.s.task.scheduled.ClusterSchedules : Check cluster status schedule. 2024-05-06 14:12:40.284 INFO 17654 --- [pool-ocp-schedules-20,2577fda30450465d,d0e0a52cca48] c.o.o.s.task.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-05-06 14:12:40.285 INFO 17654 --- [pool-ocp-schedules-1,1322d145243b4e9b,e188acf197ec] c.o.o.s.task.scheduled.ClusterSchedules : Check all standby tenant 2024-05-06 14:12:40.285 INFO 17654 --- [pool-ocp-schedules-12,9f3c75791d2f4401,e678b55af977] c.o.o.s.task.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-05-06 14:12:40.287 INFO 17654 --- [pool-ocp-schedules-5,410ec6eadd3b4673,ba1e192ba69e] c.o.o.s.t.b.c.AbstractAllClusterTask : Check status for all clusters executed completed, tryCount=1, successCount=0 2024-05-06 14:12:40.293 INFO 17654 --- [pool-ocp-schedules-20,2577fda30450465d,d0e0a52cca48] c.o.o.s.t.b.c.AbstractAllClusterTask : Sync all clusters executed completed, tryCount=1, successCount=0 2024-05-06 14:12:40.300 INFO 17654 --- [pool-ocp-schedules-12,9f3c75791d2f4401,e678b55af977] c.o.o.s.t.b.c.AbstractAllClusterTask : Check all standby clusters sync delay time executed completed, tryCount=1, successCount=0 2024-05-06 14:12:40.345 INFO 17654 --- [pool-ocp-schedules-11,c0eaae783cb94199,9e26b71d17bd] c.o.o.s.task.scheduled.ClusterSchedules : Check host agent status schedule. 2024-05-06 14:12:40.345 INFO 17654 --- [pool-ocp-schedules-3,37e13fcf68a441d7,7da5389cc2ba] c.o.o.s.task.scheduled.ClusterSchedules : Check host status schedule. 2024-05-06 14:12:40.346 INFO 17654 --- [pool-host-check-agent-status1,c0eaae783cb94199,48601fe1a59a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=1, ip=127.0.0.1, originalStatus=ONLINE 2024-05-06 14:12:40.346 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=1, ip=127.0.0.1, originalStatus=ONLINE 2024-05-06 14:12:40.347 INFO 17654 --- [ForkJoinPool-94252-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.348 INFO 17654 --- [ForkJoinPool-94252-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.348 INFO 17654 --- [ForkJoinPool-94252-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:40.349 INFO 17654 --- [ForkJoinPool-94252-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2024-05-06 14:12:40.350 INFO 17654 --- [ForkJoinPool-94252-worker-9,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.2.1.1 2024-05-06 14:12:40.351 INFO 17654 --- [pool-ocp-schedules-19,75eae16850db435e,1f5d09f71361] c.o.o.s.task.scheduled.ClusterSchedules : Check host clockdiff schedule. 2024-05-06 14:12:40.352 INFO 17654 --- [pool-host-check-clockdiff1,75eae16850db435e,3c9299cfd198] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[127.0.0.1], timeoutMillis=20000 2024-05-06 14:12:40.364 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.365 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.365 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:40.366 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2024-05-06 14:12:40.391 INFO 17654 --- [pool-host-check-clockdiff1,75eae16850db435e,3c9299cfd198] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1714975960 0 0 , error= 2024-05-06 14:12:40.394 INFO 17654 --- [pool-host-check-agent-status1,c0eaae783cb94199,48601fe1a59a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:40.394 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:40.397 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:40.397 INFO 17654 --- [pool-host-check-agent-status1,c0eaae783cb94199,48601fe1a59a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:40.438 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://127.0.0.1:62888/api/v1/time, params:null 2024-05-06 14:12:40.438 INFO 17654 --- [pool-host-check-agent-status1,c0eaae783cb94199,48601fe1a59a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://127.0.0.1:62888/api/v1/agent/status, params:null 2024-05-06 14:12:40.441 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=1, ip=127.0.0.1, timestamp=2024-05-06T14:12:40.440596586+08:00 2024-05-06 14:12:40.442 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=1, lastAvailableTime=2024-05-06T14:12:40.441+08:00 2024-05-06 14:12:40.445 INFO 17654 --- [pool-host-check-agent-status1,c0eaae783cb94199,48601fe1a59a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=127.0.0.1 2024-05-06 14:12:40.445 INFO 17654 --- [pool-host-check-agent-status1,c0eaae783cb94199,48601fe1a59a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=127.0.0.1 2024-05-06 14:12:40.446 INFO 17654 --- [pool-host-check-agent-status1,c0eaae783cb94199,48601fe1a59a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=127.0.0.1 2024-05-06 14:12:40.446 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2024-05-06T14:12:40.441+08:00 and status AVAILABLE 2024-05-06 14:12:40.455 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=1 2024-05-06 14:12:40.467 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:40.468 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.469 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.469 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:40.469 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2024-05-06 14:12:40.505 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:40.507 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:40.516 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:40.516 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.517 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.517 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:40.518 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2024-05-06 14:12:40.519 WARN 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] idcName is empty, zoneName=zone1 2024-05-06 14:12:40.520 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.520 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:40.521 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2024-05-06 14:12:40.522 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2024-05-06 14:12:40.538 INFO 17654 --- [alarm-task-1,9d1cb1ba51044be6,9a487cc7496d] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-05-06T14:12:40.537398+08:00, lastProcessTime=2024-05-06T14:12:30.538919+08:00 2024-05-06 14:12:40.542 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2024-05-06 14:12:40.548 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2024-05-06 14:12:40.548 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=127.0.0.1, port=2882, sqlPort=2881, installPath=/mnt/weixiaoOBD/oceanbase, runPath=/mnt/weixiaoOBD/oceanbase, runUser=root, version=4.2.1.1_101000062023110109-7cb0fb494fce3962ae3f067991d6581c96bc0a9e(Nov 1 2023 09:55:47), withRootserver=true, hostId=1, status=RUNNING, innerStatus=ACTIVE, startTime=2024-04-30T12:15:59+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=127.0.0.1, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.2.1.1_101000062023110109-7cb0fb494fce3962ae3f067991d6581c96bc0a9e(Nov 1 2023 09:55:47), withRootserver=true, hostId=1, status=RUNNING, innerStatus=ACTIVE, startTime=2024-04-30T12:15:58.515395+08:00, stopTime=1970-01-01T08:00+08:00} 2024-05-06 14:12:40.553 INFO 17654 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 95354, operation:EXECUTE, state: RUNNING 2024-05-06 14:12:40.576 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=127.0.0.1, port=2882, sqlPort=2881, installPath=/mnt/weixiaoOBD/oceanbase, runPath=/mnt/weixiaoOBD/oceanbase, runUser=root, version=4.2.1.1_101000062023110109-7cb0fb494fce3962ae3f067991d6581c96bc0a9e(Nov 1 2023 09:55:47), withRootserver=true, hostId=1, status=RUNNING, innerStatus=ACTIVE, startTime=2024-04-30T12:15:58.515395+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2024-05-06 14:12:40.584 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2024-05-06 14:12:40.590 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,dcdea7c35bd3] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=95354, context=Context{parallelIdx=-1, stringMap={task_instance_id=98913, task_operation=execute, latest_execution_start_time=2024-05-06T14:12:40.549+08:00, sub_task_instance_name=Check obproxy connection status, sub_task_instance_id=95354}, listMap={}}, executor=172.17.0.1 2024-05-06 14:12:40.592 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:40.592 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.593 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.593 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:40.594 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2024-05-06 14:12:40.595 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster weixiaoOBD 2024-05-06 14:12:40.603 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 1, sqlPort: 2881 2024-05-06 14:12:40.607 INFO 17654 --- [pool-subtask-executor27,e6731b8a02884b1b,dcdea7c35bd3] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 95354, operation:EXECUTE, state: SUCCESSFUL 2024-05-06 14:12:40.610 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:40.613 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:40.615 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2024-05-06 14:12:40.645 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2024-05-06 14:12:40.666 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2024-05-06 14:12:40.724 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 1, sqlPort: 2881 got ObProcessInfoResult(pid=10136, runPath=/mnt/weixiaoOBD/oceanbase, runUser=root, execute=/mnt/weixiaoOBD/oceanbase/bin/observer, installPath=/mnt/weixiaoOBD/oceanbase) 2024-05-06 14:12:40.726 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2024-05-06 14:12:40.740 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:40.741 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.742 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:40.742 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:40.742 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2024-05-06 14:12:40.743 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2024-05-06 14:12:40.759 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365 2024-05-06 14:12:40.759 INFO 17654 --- [ForkJoinPool-94253-worker-9,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=weixiaoOBD, obClusterId=1714450365, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson={"ObCluster":"weixiaoOBD","ObClusterId":1714450365,"ObRegion":"weixiaoOBD","ObRegionId":1714450365,"ReadonlyRsList":[],"RsList":[{"address":"127.0.0.1:2882","role":"LEADER","sql_port":2881}],"Type":"PRIMARY","timestamp":1714975561084000}, createTime=2024-04-30T12:50:02+08:00, creator=admin, obVersion=4.2.1.1, tenantCount=5) 2024-05-06 14:12:40.773 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2024-05-06 14:12:40.815 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2024-05-06 14:12:40.826 INFO 17654 --- [alarm-task-1,9d1cb1ba51044be6,9a487cc7496d] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-05-06T14:12:40.537398+08:00 2024-05-06 14:12:40.829 INFO 17654 --- [pool-host-check-host-status1,37e13fcf68a441d7,6593ed792112] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2024-05-06 14:12:40.889 INFO 17654 --- [pool-10-thread-8,db45a6a9e0cb4872,c4cc83ff7951] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get outline history 2024-05-06 14:12:40.889 INFO 17654 --- [pool-10-thread-7,db45a6a9e0cb4872,fddb7845d610] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get Cluster Sql Stat 2024-05-06 14:12:40.889 INFO 17654 --- [pool-10-thread-6,db45a6a9e0cb4872,ab5215e2e442] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to get cluster trans stat 2024-05-06 14:12:40.889 INFO 17654 --- [pool-10-thread-5,db45a6a9e0cb4872,ab976de71fbe] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster session stat 2024-05-06 14:12:40.895 INFO 17654 --- [ForkJoinPool-6-worker-8,db45a6a9e0cb4872,6313fb03dade] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get tenant session stat of weixiaoOBD 2024-05-06 14:12:40.895 INFO 17654 --- [ForkJoinPool-6-worker-8,db45a6a9e0cb4872,6313fb03dade] c.o.o.p.o.i.OasSessionStatServiceImpl : begin to get session of weixiaoOBD 2024-05-06 14:12:40.900 INFO 17654 --- [pool-10-thread-6,db45a6a9e0cb4872,ab5215e2e442] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to attach trans id 2024-05-06 14:12:40.900 INFO 17654 --- [pool-10-thread-6,db45a6a9e0cb4872,ab5215e2e442] c.o.o.p.t.i.ObTransactionDiagServiceImpl : finish fetching trans data 2024-05-06 14:12:40.930 INFO 17654 --- [pool-10-thread-7,db45a6a9e0cb4872,fddb7845d610] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster slow Sql Stat 2024-05-06 14:12:40.931 WARN 17654 --- [ForkJoinPool-6-worker-8,db45a6a9e0cb4872,6313fb03dade] c.o.o.p.oas.internal.OasStatServiceImpl : Failed to get session info of :weixiaoOBD com.oceanbase.ocp.service.profile.exception.CredentialMissingException: [OCP CredentialMissingException]: status=428 PRECONDITION_REQUIRED, errorCode=IAM_CREDENTIAL_REQUIRED, args=weixiaoOBD,ocp,root at com.oceanbase.ocp.service.profile.exception.CredentialMissingException.ob(CredentialMissingException.java:34) at com.oceanbase.ocp.service.credential.CredentialServiceImpl.acquireJdbcPasswordInner(CredentialServiceImpl.java:158) at com.oceanbase.ocp.service.credential.CredentialServiceImpl.acquireObPassword(CredentialServiceImpl.java:135) at com.oceanbase.ocp.service.credential.CredentialServiceImpl$$FastClassBySpringCGLIB$$6855c59e.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.service.credential.CredentialServiceImpl$$EnhancerBySpringCGLIB$$ba0d2321.acquireObPassword() at com.oceanbase.ocp.service.ob.obsdk.factory.ConnectPropertiesBuilder.acquirePassword(ConnectPropertiesBuilder.java:204) at com.oceanbase.ocp.service.ob.obsdk.factory.ConnectPropertiesBuilder.buildConnectProperties(ConnectPropertiesBuilder.java:97) at com.oceanbase.ocp.service.ob.obsdk.factory.ObAccessorFactory.buildConnectProperties(ObAccessorFactory.java:173) at com.oceanbase.ocp.service.ob.obsdk.factory.ObAccessorFactory.createObAccessor(ObAccessorFactory.java:57) at com.oceanbase.ocp.obops.internal.tenant.TenantSessionServiceImpl.lambda$countSession$1(TenantSessionServiceImpl.java:242) at java.lang.Iterable.forEach(Iterable.java:75) at com.oceanbase.ocp.obops.internal.tenant.TenantSessionServiceImpl.countSession(TenantSessionServiceImpl.java:214) at com.oceanbase.ocp.perf.oas.internal.OasSessionStatServiceImpl.getTenantSessionStat(OasSessionStatServiceImpl.java:67) at com.oceanbase.ocp.perf.oas.internal.OasStatServiceImpl.lambda$null$9(OasStatServiceImpl.java:278) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) at java.util.concurrent.ForkJoinTask.doInvoke(ForkJoinTask.java:401) at java.util.concurrent.ForkJoinTask.invoke(ForkJoinTask.java:734) at java.util.stream.ForEachOps$ForEachOp.evaluateParallel(ForEachOps.java:159) at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(ForEachOps.java:173) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:233) at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485) at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:650) at com.oceanbase.ocp.perf.oas.internal.OasStatServiceImpl.lambda$getClusterSessionStat$10(OasStatServiceImpl.java:273) at java.util.concurrent.ForkJoinTask$AdaptedRunnableAction.exec(ForkJoinTask.java:1386) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) 2024-05-06 14:12:40.931 INFO 17654 --- [pool-10-thread-5,db45a6a9e0cb4872,ab976de71fbe] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching session stat 2024-05-06 14:12:40.932 INFO 17654 --- [pool-10-thread-7,db45a6a9e0cb4872,fddb7845d610] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster anomaly sql Stat 2024-05-06 14:12:40.933 INFO 17654 --- [pool-10-thread-7,db45a6a9e0cb4872,fddb7845d610] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching cluster sql stat 2024-05-06 14:12:40.964 INFO 17654 --- [pool-10-thread-8,db45a6a9e0cb4872,c4cc83ff7951] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching outline history 2024-05-06 14:12:41.080 INFO 17654 --- [pool-ocp-schedules-2,,] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2024-05-06 14:12:41.222 INFO 17654 --- [pool-task-coordinator2,36cdba5d54dc4768,16537d8c4d64] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:98913, status:SUCCESS 2024-05-06 14:12:41.223 INFO 17654 --- [pool-task-coordinator2,36cdba5d54dc4768,16537d8c4d64] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:98913, status:SUCCESS 2024-05-06 14:12:41.483 WARN 17654 --- [pool-ocp-async-6,6f39d8bb667a45e8,0fcd311e430c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:41.884 INFO 17654 --- [pool-prometheus-minute-schedule-1,e4fd94c5dc5f477a,4a8a86afaa23] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714975980, interval=60 2024-05-06 14:12:41.892 INFO 17654 --- [pool-prometheus-minute-schedule-1,e4fd94c5dc5f477a,4a8a86afaa23] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:41.974 INFO 17654 --- [pool-ocp-async-10,5ab508e1cdbe4e64,8fc97022f918] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:42.344 INFO 17654 --- [pool-ocp-async-6,2bed6be9eb2e4a56,31b786b18694] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-05-06 14:12:42.717 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,8a3d161aa99f4285,6e7bf2e6b25c] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/tenantsView?null, client=192.168.0.57, traceId=8a3d161aa99f4285, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObTenantController.listAllTenantsView(Pageable,String,List,Boolean,String,Boolean,List,List), args=Page request [number: 0, size 2000, sort: id: DESC],] 2024-05-06 14:12:42.747 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,8a3d161aa99f4285,6e7bf2e6b25c] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/tenantsView client=192.168.0.57, traceId=8a3d161aa99f4285, duration=39 ms] 2024-05-06 14:12:42.882 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,d00c47fefb774dc5,160e8dc746c9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=TENANT&type=TOP&maxPoints=360, client=192.168.0.57, traceId=d00c47fefb774dc5, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,Long), args=Page request [number: 0, size 2000, sort: id: ASC],TOP,TENANT,] 2024-05-06 14:12:42.914 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,d305abc86a4345ab,24639d2f19e2] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/tenants?page=1&size=10, client=192.168.0.57, traceId=d305abc86a4345ab, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObTenantController.listAllTenants(Pageable,String,List,Boolean,String,Boolean,List,Boolean,List), args=Page request [number: 0, size 10, sort: id: DESC],false,] 2024-05-06 14:12:42.930 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,d305abc86a4345ab,24639d2f19e2] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/tenants client=192.168.0.57, traceId=d305abc86a4345ab, duration=26 ms] 2024-05-06 14:12:42.936 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,d00c47fefb774dc5,160e8dc746c9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=192.168.0.57, traceId=d00c47fefb774dc5, duration=60 ms] 2024-05-06 14:12:43.168 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 172.17.0.1:8080 refreshes policies... 2024-05-06 14:12:43.169 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-05-06 14:12:43.354 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,bc096fe923354ef5,85b53abd07c6] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2024-05-06T13%3A12%3A41%2B08%3A00&endTime=2024-05-06T14%3A12%3A41%2B08%3A00&metrics=tps_rt&queryAsync=true&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id%2Ctenant_name&limit=5&maxPoints=360, client=192.168.0.57, traceId=bc096fe923354ef5, method=IterableResponse com.oceanbase.ocp.server.common.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Long,Integer,Integer,String,Boolean), args=2024-05-06T13:12:41+08:00,2024-05-06T14:12:41+08:00,tps_rt,app,ob_cluster_name,ob_cluster_id,tenant_name,0,0,5,360,app:OB,true,] 2024-05-06 14:12:43.359 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,bc096fe923354ef5,85b53abd07c6] c.o.o.service.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2024-05-06 14:12:43.363 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,bc096fe923354ef5,85b53abd07c6] c.o.o.service.ob.ObAuthorizedFacadeImpl : readable tenant ids:[1, 2, 3, 4, 5] 2024-05-06 14:12:43.375 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-9,445d17c3802a4ad6,6a969eea9f3e] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2024-05-06T13%3A12%3A41%2B08%3A00&endTime=2024-05-06T14%3A12%3A41%2B08%3A00&metrics=tps&queryAsync=true&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id%2Ctenant_name&limit=5&maxPoints=360, client=192.168.0.57, traceId=445d17c3802a4ad6, method=IterableResponse com.oceanbase.ocp.server.common.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Long,Integer,Integer,String,Boolean), args=2024-05-06T13:12:41+08:00,2024-05-06T14:12:41+08:00,tps,app,ob_cluster_name,ob_cluster_id,tenant_name,0,0,5,360,app:OB,true,] 2024-05-06 14:12:43.381 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-9,445d17c3802a4ad6,6a969eea9f3e] c.o.o.service.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2024-05-06 14:12:43.385 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-9,445d17c3802a4ad6,6a969eea9f3e] c.o.o.service.ob.ObAuthorizedFacadeImpl : readable tenant ids:[1, 2, 3, 4, 5] 2024-05-06 14:12:43.425 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-5,bc096fe923354ef5,85b53abd07c6] c.o.o.m.query.MetricQueryServiceImpl : Scan data async get empty result, metric = tps_rt 2024-05-06 14:12:43.425 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-5,bc096fe923354ef5,85b53abd07c6] c.o.o.m.query.MetricQueryServiceImpl : Scan data async result range is away from start time, fall back to full query. metric = tps_rt, minTimestamp = 0, minTimeBuffer = 0, startTime = 1714972361 2024-05-06 14:12:43.436 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-7,d5376814d1a84ad5,003e6967a2a4] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2024-05-06T13%3A12%3A41%2B08%3A00&endTime=2024-05-06T14%3A12%3A41%2B08%3A00&metrics=sql_all_count&queryAsync=true&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id%2Ctenant_name&limit=5&maxPoints=360, client=192.168.0.57, traceId=d5376814d1a84ad5, method=IterableResponse com.oceanbase.ocp.server.common.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Long,Integer,Integer,String,Boolean), args=2024-05-06T13:12:41+08:00,2024-05-06T14:12:41+08:00,sql_all_count,app,ob_cluster_name,ob_cluster_id,tenant_name,0,0,5,360,app:OB,true,] 2024-05-06 14:12:43.441 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-7,d5376814d1a84ad5,003e6967a2a4] c.o.o.service.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2024-05-06 14:12:43.445 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-7,d5376814d1a84ad5,003e6967a2a4] c.o.o.service.ob.ObAuthorizedFacadeImpl : readable tenant ids:[1, 2, 3, 4, 5] 2024-05-06 14:12:43.447 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-9,445d17c3802a4ad6,6a969eea9f3e] c.o.o.m.query.MetricQueryServiceImpl : Scan data async get empty result, metric = tps 2024-05-06 14:12:43.447 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-9,445d17c3802a4ad6,6a969eea9f3e] c.o.o.m.query.MetricQueryServiceImpl : Scan data async result range is away from start time, fall back to full query. metric = tps, minTimestamp = 0, minTimeBuffer = 0, startTime = 1714972361 2024-05-06 14:12:43.458 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,ed025a52ae1a4a54,f955d173edfa] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2024-05-06T13%3A12%3A41%2B08%3A00&endTime=2024-05-06T14%3A12%3A41%2B08%3A00&metrics=sql_all_rt&queryAsync=true&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id%2Ctenant_name&limit=5&maxPoints=360, client=192.168.0.57, traceId=ed025a52ae1a4a54, method=IterableResponse com.oceanbase.ocp.server.common.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Long,Integer,Integer,String,Boolean), args=2024-05-06T13:12:41+08:00,2024-05-06T14:12:41+08:00,sql_all_rt,app,ob_cluster_name,ob_cluster_id,tenant_name,0,0,5,360,app:OB,true,] 2024-05-06 14:12:43.462 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,ed025a52ae1a4a54,f955d173edfa] c.o.o.service.ob.ObAuthorizedFacadeImpl : tenant authorizedIdentifiers: [] 2024-05-06 14:12:43.468 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-7,d5376814d1a84ad5,003e6967a2a4] c.o.o.m.query.MetricQueryServiceImpl : Scan data async get empty result, metric = sql_all_count 2024-05-06 14:12:43.468 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-7,d5376814d1a84ad5,003e6967a2a4] c.o.o.m.query.MetricQueryServiceImpl : Scan data async result range is away from start time, fall back to full query. metric = sql_all_count, minTimestamp = 0, minTimeBuffer = 0, startTime = 1714972361 2024-05-06 14:12:43.469 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,ed025a52ae1a4a54,f955d173edfa] c.o.o.service.ob.ObAuthorizedFacadeImpl : readable tenant ids:[1, 2, 3, 4, 5] 2024-05-06 14:12:43.492 INFO 17654 --- [pool-scanner-115275265-1,bc096fe923354ef5,7e5ffbdd1d0c] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.495 INFO 17654 --- [pool-scanner-115275266-1,bc096fe923354ef5,5559735551c3] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.496 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-4,ed025a52ae1a4a54,f955d173edfa] c.o.o.m.query.MetricQueryServiceImpl : Scan data async get empty result, metric = sql_all_rt 2024-05-06 14:12:43.497 INFO 17654 --- [pool-scanner-115275269-1,445d17c3802a4ad6,455bee362573] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.501 INFO 17654 --- [pool-scanner-115275267-1,bc096fe923354ef5,2fff2e9abf99] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.503 INFO 17654 --- [pool-scanner-115275268-1,445d17c3802a4ad6,c753985bcf93] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.535 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-4,ed025a52ae1a4a54,f955d173edfa] c.o.o.m.query.MetricQueryServiceImpl : Scan data async result range is away from start time, fall back to full query. metric = sql_all_rt, minTimestamp = 0, minTimeBuffer = 0, startTime = 1714972361 2024-05-06 14:12:43.509 INFO 17654 --- [pool-scanner-115275270-1,445d17c3802a4ad6,b318ce3371c0] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.519 INFO 17654 --- [pool-scanner-115275271-1,d5376814d1a84ad5,f9c5467626ab] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.519 INFO 17654 --- [pool-scanner-115275272-1,d5376814d1a84ad5,419e2c63e72b] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.524 INFO 17654 --- [pool-scanner-115275273-1,d5376814d1a84ad5,54bb84a547f2] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.526 INFO 17654 --- [pool-scanner-115275276-1,d5376814d1a84ad5,3c5b1e6ce75b] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.526 INFO 17654 --- [pool-scanner-115275275-1,d5376814d1a84ad5,9e76ba5514a1] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.527 INFO 17654 --- [pool-scanner-115275274-1,d5376814d1a84ad5,ec457f2919e4] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.547 WARN 17654 --- [pool-ocp-async-7,0057dae9e31441e1,277df392c071] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:43.550 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,bc096fe923354ef5,85b53abd07c6] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.0.57, traceId=bc096fe923354ef5, duration=203 ms] 2024-05-06 14:12:43.550 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-9,445d17c3802a4ad6,6a969eea9f3e] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.0.57, traceId=445d17c3802a4ad6, duration=180 ms] 2024-05-06 14:12:43.565 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-7,d5376814d1a84ad5,003e6967a2a4] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.0.57, traceId=d5376814d1a84ad5, duration=136 ms] 2024-05-06 14:12:43.587 INFO 17654 --- [pool-scanner-115275277-1,ed025a52ae1a4a54,204ce1af4203] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.598 INFO 17654 --- [pool-scanner-115275279-1,ed025a52ae1a4a54,e38ec07ddef8] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.603 INFO 17654 --- [pool-scanner-115275278-1,ed025a52ae1a4a54,73379fdb0c69] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.609 INFO 17654 --- [pool-scanner-115275281-1,ed025a52ae1a4a54,92dc254060cb] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.612 INFO 17654 --- [pool-scanner-115275284-1,ed025a52ae1a4a54,473225a82163] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.614 INFO 17654 --- [pool-scanner-115275282-1,ed025a52ae1a4a54,06610d037e48] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.616 INFO 17654 --- [pool-scanner-115275280-1,ed025a52ae1a4a54,e63501af8fdc] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.624 INFO 17654 --- [pool-scanner-115275283-1,ed025a52ae1a4a54,0d5c9dd424b6] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.624 INFO 17654 --- [pool-scanner-115275285-1,ed025a52ae1a4a54,ed0eea300307] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.632 INFO 17654 --- [pool-scanner-115275286-1,ed025a52ae1a4a54,8bd52b822623] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.633 INFO 17654 --- [pool-scanner-115275288-1,ed025a52ae1a4a54,e87e9c682d29] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.638 INFO 17654 --- [pool-scanner-115275287-1,ed025a52ae1a4a54,2e948dada839] c.o.o.m.store.RollupMetricDataStore : fetchFromDb, nodesCountFromDb=290, nodesFilledCount=0 2024-05-06 14:12:43.703 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,ed025a52ae1a4a54,f955d173edfa] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=192.168.0.57, traceId=ed025a52ae1a4a54, duration=252 ms] 2024-05-06 14:12:43.975 INFO 17654 --- [pool-ocp-async-3,1c03bf3269d442f3,b076e4081925] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:44.828 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,ce7f0199e23c4b1b,2b50dd6290e8] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/tenants?null, client=192.168.0.57, traceId=ce7f0199e23c4b1b, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObTenantController.listAllTenants(Pageable,String,List,Boolean,String,Boolean,List,Boolean,List), args=Page request [number: 0, size 2000, sort: id: DESC],false,] 2024-05-06 14:12:44.830 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,032675b8ee554ffb,f094dbbf2e5a] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances?clusterId=1&tenantId=5&status=RUNNING%2CFAILED, client=192.168.0.57, traceId=032675b8ee554ffb, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.TaskController.listTaskInstances(String,Pageable,String,List,String,TaskType,String,Long,String,Long,Long,Long), args=Page request [number: 0, size 2000, sort: id: DESC],RUNNING,FAILED,MANUAL,1,5,] 2024-05-06 14:12:44.833 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,d55b8792f64d42c0,732e74a6fc43] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=192.168.0.57, traceId=d55b8792f64d42c0, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ProfileController.userInfo(), args=] 2024-05-06 14:12:44.836 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,12aec8b219f74327,e6891ccf2796] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/sensitiveDataKey?null, client=192.168.0.57, traceId=12aec8b219f74327, method=SuccessResponse com.oceanbase.ocp.server.common.controller.InfoController.getSensitiveDataPublicKey(), args=] 2024-05-06 14:12:44.836 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,12aec8b219f74327,e6891ccf2796] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/sensitiveDataKey client=192.168.0.57, traceId=12aec8b219f74327, duration=5 ms] 2024-05-06 14:12:44.838 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,d55b8792f64d42c0,732e74a6fc43] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=192.168.0.57, traceId=d55b8792f64d42c0, duration=10 ms] 2024-05-06 14:12:44.839 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,0ff0055eec1a491f,458aff8ad060] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/info?null, client=192.168.0.57, traceId=0ff0055eec1a491f, method=OcpBuildInfo com.oceanbase.ocp.server.common.controller.InfoController.info(), args=] 2024-05-06 14:12:44.839 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,0ff0055eec1a491f,458aff8ad060] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/info client=192.168.0.57, traceId=0ff0055eec1a491f, duration=5 ms] 2024-05-06 14:12:44.840 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-9,cdefc80f0fa144dc,49e5bd68a1af] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=192.168.0.57, traceId=cdefc80f0fa144dc, method=SuccessResponse com.oceanbase.ocp.server.common.controller.PropertyController.getSystemInfo(), args=] 2024-05-06 14:12:44.840 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-9,cdefc80f0fa144dc,49e5bd68a1af] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=192.168.0.57, traceId=cdefc80f0fa144dc, duration=5 ms] 2024-05-06 14:12:44.844 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,ce7f0199e23c4b1b,2b50dd6290e8] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/tenants client=192.168.0.57, traceId=ce7f0199e23c4b1b, duration=24 ms] 2024-05-06 14:12:44.873 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-1,e4d0120a41964d94,f16c69140f2a] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=192.168.0.57, traceId=e4d0120a41964d94, method=OffsetDateTime com.oceanbase.ocp.server.common.controller.InfoController.time(), args=] 2024-05-06 14:12:44.873 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-1,e4d0120a41964d94,f16c69140f2a] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=192.168.0.57, traceId=e4d0120a41964d94, duration=6 ms] 2024-05-06 14:12:44.876 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,909be789f2e04eae,9a47787f6d4f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/alarm/alarms/actived?null, client=192.168.0.57, traceId=909be789f2e04eae, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.AlarmController.fetchActivedAlarms(String,String,List,String,List,List,OffsetDateTime,OffsetDateTime,String,Pageable), args=Page request [number: 0, size 10, sort: id: DESC],] 2024-05-06 14:12:44.877 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,917bd5faeb064d60,e0e20ab75331] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/state-statistics?null, client=192.168.0.57, traceId=917bd5faeb064d60, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskStateSummary(TaskType), args=MANUAL,] 2024-05-06 14:12:44.883 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,917bd5faeb064d60,e0e20ab75331] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/state-statistics client=192.168.0.57, traceId=917bd5faeb064d60, duration=15 ms] 2024-05-06 14:12:44.884 INFO 17654 --- [pool-prometheus-minute-schedule-1,66d610e2113e43c7,6683efb742bc] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714975980, interval=60 2024-05-06 14:12:44.885 INFO 17654 --- [pool-prometheus-hour-schedule-1,e363473e2e774f8f,5ec645048cfb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714978800, interval=3600 2024-05-06 14:12:44.892 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,032675b8ee554ffb,f094dbbf2e5a] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances client=192.168.0.57, traceId=032675b8ee554ffb, duration=71 ms] 2024-05-06 14:12:44.893 INFO 17654 --- [pool-prometheus-minute-schedule-1,66d610e2113e43c7,6683efb742bc] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:44.903 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/1/tenants/5/summary?id=1&tenantId=5, client=192.168.0.57, traceId=600170c5fa9d4c13, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ObTenantController.getTenantSummary(Long,Long), args=1,5,] 2024-05-06 14:12:44.933 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:44.939 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:44.940 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:44.940 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:44.940 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:44.941 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(60000000) */ time_to_usec(t1.MODIFY_TIME) AS UPDATE_TIME, t1.RESOURCE_POOL_ID, t1.NAME, t1.UNIT_COUNT, t1.UNIT_CONFIG_ID, t1.ZONE_LIST, t1.TENANT_ID, t1.REPLICA_TYPE, t2.NAME AS UNIT_CONFIG_NAME, t2.MAX_CPU, t2.MIN_CPU, t2.MEMORY_SIZE AS MAX_MEMORY, t2.MEMORY_SIZE AS MIN_MEMORY, t2.LOG_DISK_SIZE, t2.MAX_IOPS, t2.MIN_IOPS, t2.IOPS_WEIGHT FROM oceanbase.DBA_OB_RESOURCE_POOLS AS t1 JOIN oceanbase.DBA_OB_UNIT_CONFIGS AS t2 ON t1.UNIT_CONFIG_ID = t2.UNIT_CONFIG_ID AND t1.tenant_id = ?, args: [1008] 2024-05-06 14:12:44.950 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:44.951 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:44.959 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:44.959 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:44.960 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(5000000) */ t1.UNIT_ID, t1.RESOURCE_POOL_ID, t1.UNIT_CONFIG_ID, t1.ZONE, t1.SVR_IP, t1.SVR_PORT, t1.STATUS, t2.REPLICA_TYPE, t2.TENANT_ID, t3.TENANT_NAME, t2.NAME AS RESOURCE_POOL_NAME, t2.MODIFY_TIME AS RESOURCE_POOL_UPDATE_TIME, t1.MIGRATE_FROM_SVR_IP, t1.MIGRATE_FROM_SVR_PORT, t1.MANUAL_MIGRATE FROM oceanbase.DBA_OB_UNITS AS t1 JOIN oceanbase.DBA_OB_RESOURCE_POOLS AS t2 ON t1.RESOURCE_POOL_ID = t2.RESOURCE_POOL_ID JOIN oceanbase.DBA_OB_TENANTS t3 ON t2.TENANT_ID = t3.TENANT_ID WHERE 1=1 AND t2.tenant_id = ?, args: [1008] 2024-05-06 14:12:44.967 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:44.967 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:44.968 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') AND tenant_id = ?, args: [1008] 2024-05-06 14:12:44.976 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:44.976 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:44.977 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-9,2cdeb542b8224ffa,a5cfbf83d33f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/1/tenants/5/zones?id=1&tenantId=5, client=192.168.0.57, traceId=2cdeb542b8224ffa, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObTenantController.listObClusterZones(Long,Long), args=1,5,] 2024-05-06 14:12:44.977 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1008] 2024-05-06 14:12:45.023 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.023 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.024 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1008] 2024-05-06 14:12:45.073 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:45.074 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.081 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.081 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.082 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT `collation_name` AS collation, `character_set_name` AS charset, `id`, `is_default` FROM information_schema.collations 2024-05-06 14:12:45.094 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-9,2cdeb542b8224ffa,a5cfbf83d33f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/1/tenants/5/zones client=192.168.0.57, traceId=2cdeb542b8224ffa, duration=129 ms] 2024-05-06 14:12:45.111 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.112 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.112 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT incarnation, round_id AS log_archive_round, tenant_id, path AS backup_dest, start_scn_display AS min_first_time, checkpoint_scn_display AS max_next_time, status, truncate((time_to_usec(now()) - checkpoint_scn / 1000) / 1000000, 4) AS delay, now(6) AS check_time FROM CDB_OB_ARCHIVELOG_SUMMARY WHERE tenant_id = ? AND status = 'DOING', args: [1008] 2024-05-06 14:12:45.122 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.123 INFO 17654 --- [ForkJoinPool.commonPool-worker-14,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.123 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.123 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.124 INFO 17654 --- [ForkJoinPool.commonPool-worker-14,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.124 INFO 17654 --- [ForkJoinPool.commonPool-worker-14,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.124 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT ZONE, SVR_IP, SVR_PORT, NAME, VALUE, DATA_TYPE, SECTION, EDIT_LEVEL, INFO FROM GV$OB_PARAMETERS WHERE SCOPE = 'CLUSTER' AND name = ?, args: [_lcl_op_interval] 2024-05-06 14:12:45.124 INFO 17654 --- [ForkJoinPool.commonPool-worker-14,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [ob_enable_sql_audit] 2024-05-06 14:12:45.130 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,600170c5fa9d4c13,ea1a619d1c72] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/1/tenants/5/summary client=192.168.0.57, traceId=600170c5fa9d4c13, duration=235 ms] 2024-05-06 14:12:45.134 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,cee3100f3c37461f,0a20b38611c0] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/telemetry?null, client=192.168.0.57, traceId=cee3100f3c37461f, method=SuccessResponse com.oceanbase.ocp.controller.TelemetryController.get(), args=] 2024-05-06 14:12:45.143 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=192.168.0.57, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2024-05-06 14:12:45.143 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-4,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/maz/state, client=192.168.0.57, traceId=] 2024-05-06 14:12:45.143 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=192.168.0.57, traceId=, duration=0 ms] 2024-05-06 14:12:45.145 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-7,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=192.168.0.57, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2024-05-06 14:12:45.145 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-7,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/mc/info, client=192.168.0.57, traceId=] 2024-05-06 14:12:45.145 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-7,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=192.168.0.57, traceId=, duration=0 ms] 2024-05-06 14:12:45.145 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,cee3100f3c37461f,0a20b38611c0] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/telemetry client=192.168.0.57, traceId=cee3100f3c37461f, duration=15 ms] 2024-05-06 14:12:45.203 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,909be789f2e04eae,9a47787f6d4f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/alarms/actived client=192.168.0.57, traceId=909be789f2e04eae, duration=336 ms] 2024-05-06 14:12:45.480 WARN 17654 --- [pool-ocp-async-9,7f13521ffbbd4f79,9930a605ba46] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:45.741 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,549a9cb772da4f26,08f85b74bae3] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/unitSpecs/limitRule?clusterId=1, client=192.168.0.57, traceId=549a9cb772da4f26, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ObUnitSpecController.getUnitSpecLimitRule(Long), args=1,] 2024-05-06 14:12:45.742 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-1,bb77ab9fc52b45a0,1138d93ac194] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/unitSpecs?null, client=192.168.0.57, traceId=bb77ab9fc52b45a0, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObUnitSpecController.listUnitSpecs(Pageable,String,List,Long), args=Page request [number: 0, size 2000, sort: id: ASC],] 2024-05-06 14:12:45.743 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,84ba8da77ae94705,b4abbaec2c78] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/1?id=1, client=192.168.0.57, traceId=84ba8da77ae94705, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ObClusterController.getObCluster(Long), args=1,] 2024-05-06 14:12:45.743 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/1/tenants/5/siblingTenants?id=1&tenantId=5, client=192.168.0.57, traceId=28395ca7310a4b76, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObTenantStandbyController.listSiblingTenants(Long,Long), args=1,5,] 2024-05-06 14:12:45.752 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-1,bb77ab9fc52b45a0,1138d93ac194] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/unitSpecs client=192.168.0.57, traceId=bb77ab9fc52b45a0, duration=16 ms] 2024-05-06 14:12:45.771 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,549a9cb772da4f26,08f85b74bae3] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.771 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,549a9cb772da4f26,08f85b74bae3] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.772 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,549a9cb772da4f26,08f85b74bae3] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.772 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,549a9cb772da4f26,08f85b74bae3] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT ZONE, SVR_IP, SVR_PORT, NAME, VALUE, DATA_TYPE, SECTION, EDIT_LEVEL, INFO FROM GV$OB_PARAMETERS WHERE SCOPE = 'CLUSTER' AND name = ?, args: [__min_full_resource_pool_memory] 2024-05-06 14:12:45.775 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.775 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.o.o.i.t.TenantStandbyServiceImpl : These operators for clusterIds=[1] have been created. 2024-05-06 14:12:45.776 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.776 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.777 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') AND tenant_id = ?, args: [1008] 2024-05-06 14:12:45.778 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-5,549a9cb772da4f26,08f85b74bae3] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/unitSpecs/limitRule client=192.168.0.57, traceId=549a9cb772da4f26, duration=42 ms] 2024-05-06 14:12:45.786 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.786 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.786 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1008] 2024-05-06 14:12:45.799 INFO 17654 --- [ForkJoinPool.commonPool-worker-14,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:45.799 INFO 17654 --- [ForkJoinPool.commonPool-worker-14,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.800 INFO 17654 --- [ForkJoinPool.commonPool-worker-14,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.800 INFO 17654 --- [ForkJoinPool.commonPool-worker-14,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.801 INFO 17654 --- [ForkJoinPool.commonPool-worker-14,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [obconfig_url] 2024-05-06 14:12:45.803 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-8,84ba8da77ae94705,b4abbaec2c78] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/1 client=192.168.0.57, traceId=84ba8da77ae94705, duration=67 ms] 2024-05-06 14:12:45.834 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:45.834 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.835 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.835 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.836 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(60000000) */ time_to_usec(t1.MODIFY_TIME) AS UPDATE_TIME, t1.RESOURCE_POOL_ID, t1.NAME, t1.UNIT_COUNT, t1.UNIT_CONFIG_ID, t1.ZONE_LIST, t1.TENANT_ID, t1.REPLICA_TYPE, t2.NAME AS UNIT_CONFIG_NAME, t2.MAX_CPU, t2.MIN_CPU, t2.MEMORY_SIZE AS MAX_MEMORY, t2.MEMORY_SIZE AS MIN_MEMORY, t2.LOG_DISK_SIZE, t2.MAX_IOPS, t2.MIN_IOPS, t2.IOPS_WEIGHT FROM oceanbase.DBA_OB_RESOURCE_POOLS AS t1 JOIN oceanbase.DBA_OB_UNIT_CONFIGS AS t2 ON t1.UNIT_CONFIG_ID = t2.UNIT_CONFIG_ID AND t1.tenant_id = ?, args: [1002] 2024-05-06 14:12:45.836 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.836 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.837 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1008] 2024-05-06 14:12:45.845 INFO 17654 --- [ForkJoinPool.commonPool-worker-11,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.845 INFO 17654 --- [ForkJoinPool.commonPool-worker-11,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.845 INFO 17654 --- [ForkJoinPool.commonPool-worker-11,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.846 INFO 17654 --- [ForkJoinPool.commonPool-worker-4,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.846 INFO 17654 --- [ForkJoinPool.commonPool-worker-11,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(60000000) */ time_to_usec(t1.MODIFY_TIME) AS UPDATE_TIME, t1.RESOURCE_POOL_ID, t1.NAME, t1.UNIT_COUNT, t1.UNIT_CONFIG_ID, t1.ZONE_LIST, t1.TENANT_ID, t1.REPLICA_TYPE, t2.NAME AS UNIT_CONFIG_NAME, t2.MAX_CPU, t2.MIN_CPU, t2.MEMORY_SIZE AS MAX_MEMORY, t2.MEMORY_SIZE AS MIN_MEMORY, t2.LOG_DISK_SIZE, t2.MAX_IOPS, t2.MIN_IOPS, t2.IOPS_WEIGHT FROM oceanbase.DBA_OB_RESOURCE_POOLS AS t1 JOIN oceanbase.DBA_OB_UNIT_CONFIGS AS t2 ON t1.UNIT_CONFIG_ID = t2.UNIT_CONFIG_ID AND t1.tenant_id = ?, args: [1006] 2024-05-06 14:12:45.847 INFO 17654 --- [ForkJoinPool.commonPool-worker-4,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.847 INFO 17654 --- [ForkJoinPool.commonPool-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.848 INFO 17654 --- [ForkJoinPool.commonPool-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(60000000) */ time_to_usec(t1.MODIFY_TIME) AS UPDATE_TIME, t1.RESOURCE_POOL_ID, t1.NAME, t1.UNIT_COUNT, t1.UNIT_CONFIG_ID, t1.ZONE_LIST, t1.TENANT_ID, t1.REPLICA_TYPE, t2.NAME AS UNIT_CONFIG_NAME, t2.MAX_CPU, t2.MIN_CPU, t2.MEMORY_SIZE AS MAX_MEMORY, t2.MEMORY_SIZE AS MIN_MEMORY, t2.LOG_DISK_SIZE, t2.MAX_IOPS, t2.MIN_IOPS, t2.IOPS_WEIGHT FROM oceanbase.DBA_OB_RESOURCE_POOLS AS t1 JOIN oceanbase.DBA_OB_UNIT_CONFIGS AS t2 ON t1.UNIT_CONFIG_ID = t2.UNIT_CONFIG_ID AND t1.tenant_id = ?, args: [1] 2024-05-06 14:12:45.850 INFO 17654 --- [ForkJoinPool.commonPool-worker-3,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.850 INFO 17654 --- [ForkJoinPool.commonPool-worker-3,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.850 INFO 17654 --- [ForkJoinPool.commonPool-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.851 INFO 17654 --- [ForkJoinPool.commonPool-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(60000000) */ time_to_usec(t1.MODIFY_TIME) AS UPDATE_TIME, t1.RESOURCE_POOL_ID, t1.NAME, t1.UNIT_COUNT, t1.UNIT_CONFIG_ID, t1.ZONE_LIST, t1.TENANT_ID, t1.REPLICA_TYPE, t2.NAME AS UNIT_CONFIG_NAME, t2.MAX_CPU, t2.MIN_CPU, t2.MEMORY_SIZE AS MAX_MEMORY, t2.MEMORY_SIZE AS MIN_MEMORY, t2.LOG_DISK_SIZE, t2.MAX_IOPS, t2.MIN_IOPS, t2.IOPS_WEIGHT FROM oceanbase.DBA_OB_RESOURCE_POOLS AS t1 JOIN oceanbase.DBA_OB_UNIT_CONFIGS AS t2 ON t1.UNIT_CONFIG_ID = t2.UNIT_CONFIG_ID AND t1.tenant_id = ?, args: [1004] 2024-05-06 14:12:45.890 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:45.891 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.892 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.892 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.893 INFO 17654 --- [ForkJoinPool.commonPool-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(5000000) */ t1.UNIT_ID, t1.RESOURCE_POOL_ID, t1.UNIT_CONFIG_ID, t1.ZONE, t1.SVR_IP, t1.SVR_PORT, t1.STATUS, t2.REPLICA_TYPE, t2.TENANT_ID, t3.TENANT_NAME, t2.NAME AS RESOURCE_POOL_NAME, t2.MODIFY_TIME AS RESOURCE_POOL_UPDATE_TIME, t1.MIGRATE_FROM_SVR_IP, t1.MIGRATE_FROM_SVR_PORT, t1.MANUAL_MIGRATE FROM oceanbase.DBA_OB_UNITS AS t1 JOIN oceanbase.DBA_OB_RESOURCE_POOLS AS t2 ON t1.RESOURCE_POOL_ID = t2.RESOURCE_POOL_ID JOIN oceanbase.DBA_OB_TENANTS t3 ON t2.TENANT_ID = t3.TENANT_ID WHERE 1=1 AND t2.tenant_id = ?, args: [1002] 2024-05-06 14:12:45.894 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.894 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.895 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT end_scn FROM oceanbase.GV$OB_LOG_STAT WHERE tenant_id = ? AND ls_id = ? AND role = 'leader' 2024-05-06 14:12:45.901 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.o.o.i.t.TenantStandbyServiceImpl : Tenant=weixiao log restore info: LogRestoreInfo(syncScn=1714975965477539939, delayTime=null, obLsLogRestoreStatusList=null, tenantRestoreStatus=null) 2024-05-06 14:12:45.902 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-3,28395ca7310a4b76,f7b89103b6f7] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/1/tenants/5/siblingTenants client=192.168.0.57, traceId=28395ca7310a4b76, duration=166 ms] 2024-05-06 14:12:45.905 INFO 17654 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:45.905 INFO 17654 --- [ForkJoinPool.commonPool-worker-11,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:45.906 INFO 17654 --- [ForkJoinPool.commonPool-worker-3,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.906 INFO 17654 --- [ForkJoinPool.commonPool-worker-4,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=ocp_monitor 2024-05-06 14:12:45.906 INFO 17654 --- [ForkJoinPool.commonPool-worker-11,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.907 INFO 17654 --- [ForkJoinPool.commonPool-worker-3,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.907 INFO 17654 --- [ForkJoinPool.commonPool-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.907 INFO 17654 --- [ForkJoinPool.commonPool-worker-4,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.908 INFO 17654 --- [ForkJoinPool.commonPool-worker-11,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.908 INFO 17654 --- [ForkJoinPool.commonPool-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(5000000) */ t1.UNIT_ID, t1.RESOURCE_POOL_ID, t1.UNIT_CONFIG_ID, t1.ZONE, t1.SVR_IP, t1.SVR_PORT, t1.STATUS, t2.REPLICA_TYPE, t2.TENANT_ID, t3.TENANT_NAME, t2.NAME AS RESOURCE_POOL_NAME, t2.MODIFY_TIME AS RESOURCE_POOL_UPDATE_TIME, t1.MIGRATE_FROM_SVR_IP, t1.MIGRATE_FROM_SVR_PORT, t1.MANUAL_MIGRATE FROM oceanbase.DBA_OB_UNITS AS t1 JOIN oceanbase.DBA_OB_RESOURCE_POOLS AS t2 ON t1.RESOURCE_POOL_ID = t2.RESOURCE_POOL_ID JOIN oceanbase.DBA_OB_TENANTS t3 ON t2.TENANT_ID = t3.TENANT_ID WHERE 1=1 AND t2.tenant_id = ?, args: [1004] 2024-05-06 14:12:45.908 INFO 17654 --- [ForkJoinPool.commonPool-worker-11,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.908 INFO 17654 --- [ForkJoinPool.commonPool-worker-4,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:45.908 INFO 17654 --- [ForkJoinPool.commonPool-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:45.909 INFO 17654 --- [ForkJoinPool.commonPool-worker-11,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(5000000) */ t1.UNIT_ID, t1.RESOURCE_POOL_ID, t1.UNIT_CONFIG_ID, t1.ZONE, t1.SVR_IP, t1.SVR_PORT, t1.STATUS, t2.REPLICA_TYPE, t2.TENANT_ID, t3.TENANT_NAME, t2.NAME AS RESOURCE_POOL_NAME, t2.MODIFY_TIME AS RESOURCE_POOL_UPDATE_TIME, t1.MIGRATE_FROM_SVR_IP, t1.MIGRATE_FROM_SVR_PORT, t1.MANUAL_MIGRATE FROM oceanbase.DBA_OB_UNITS AS t1 JOIN oceanbase.DBA_OB_RESOURCE_POOLS AS t2 ON t1.RESOURCE_POOL_ID = t2.RESOURCE_POOL_ID JOIN oceanbase.DBA_OB_TENANTS t3 ON t2.TENANT_ID = t3.TENANT_ID WHERE 1=1 AND t2.tenant_id = ?, args: [1006] 2024-05-06 14:12:45.909 INFO 17654 --- [ForkJoinPool.commonPool-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(5000000) */ t1.UNIT_ID, t1.RESOURCE_POOL_ID, t1.UNIT_CONFIG_ID, t1.ZONE, t1.SVR_IP, t1.SVR_PORT, t1.STATUS, t2.REPLICA_TYPE, t2.TENANT_ID, t3.TENANT_NAME, t2.NAME AS RESOURCE_POOL_NAME, t2.MODIFY_TIME AS RESOURCE_POOL_UPDATE_TIME, t1.MIGRATE_FROM_SVR_IP, t1.MIGRATE_FROM_SVR_PORT, t1.MANUAL_MIGRATE FROM oceanbase.DBA_OB_UNITS AS t1 JOIN oceanbase.DBA_OB_RESOURCE_POOLS AS t2 ON t1.RESOURCE_POOL_ID = t2.RESOURCE_POOL_ID JOIN oceanbase.DBA_OB_TENANTS t3 ON t2.TENANT_ID = t3.TENANT_ID WHERE 1=1 AND t2.tenant_id = ?, args: [1] 2024-05-06 14:12:45.975 INFO 17654 --- [pool-ocp-async-2,d748e9d4fc8342fe,9f390dbc9c55] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:46.169 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 172.17.0.1:8080 refreshes policies... 2024-05-06 14:12:46.174 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-05-06 14:12:47.479 WARN 17654 --- [pool-ocp-async-3,2194c49c975342c0,72e1988c3354] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:47.581 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-9,aed9ce4e32514fdc,f4b4e37b5808] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/1/tenants/5/backup/config/backupStrategy?id=1&tenantId=5, client=192.168.0.57, traceId=aed9ce4e32514fdc, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ObTenantBackupController.queryObTenantBackupStrategy(long,long), args=1,5,] 2024-05-06 14:12:47.582 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,2e9133ae03ca4f14,344425ed1801] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/1/tenants/5/backup/overview?id=1&tenantId=5, client=192.168.0.57, traceId=2e9133ae03ca4f14, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ObTenantBackupController.getBackupOverview(long,long), args=1,5,] 2024-05-06 14:12:47.584 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-9,aed9ce4e32514fdc,f4b4e37b5808] c.o.o.b.i.u.BackupParamSecurityUtils : storage[BACKUP_STORAGE_FILE] not need desensitize accessKey. 2024-05-06 14:12:47.584 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-9,aed9ce4e32514fdc,f4b4e37b5808] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/1/tenants/5/backup/config/backupStrategy client=192.168.0.57, traceId=aed9ce4e32514fdc, duration=9 ms] 2024-05-06 14:12:47.659 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,2e9133ae03ca4f14,344425ed1801] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:47.660 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,2e9133ae03ca4f14,344425ed1801] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:47.660 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,2e9133ae03ca4f14,344425ed1801] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:47.662 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,2e9133ae03ca4f14,344425ed1801] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT incarnation, round_id AS log_archive_round, tenant_id, path AS backup_dest, IF(start_scn_display != '', start_scn_display, NULL) AS min_first_time, IF(checkpoint_scn_display != '', checkpoint_scn_display, NULL) AS max_next_time, status, IF(checkpoint_scn != '', truncate((time_to_usec(now()) - checkpoint_scn / 1000) / 1000000, 4), NULL) AS delay, now(6) AS check_time FROM CDB_OB_ARCHIVELOG_SUMMARY WHERE tenant_id = ? AND round_id = (SELECT MAX(round_id) FROM CDB_OB_ARCHIVELOG_SUMMARY WHERE tenant_id = ?)), args: [1008, 1008] 2024-05-06 14:12:47.678 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,2e9133ae03ca4f14,344425ed1801] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:47.678 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,2e9133ae03ca4f14,344425ed1801] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:47.678 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,2e9133ae03ca4f14,344425ed1801] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:47.679 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,2e9133ae03ca4f14,344425ed1801] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'time_zone' 2024-05-06 14:12:47.680 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,2e9133ae03ca4f14,344425ed1801] c.o.o.b.i.operation.BackupObOpsService : systemTenantZoneId=+08:00 2024-05-06 14:12:47.785 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-2,2e9133ae03ca4f14,344425ed1801] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/1/tenants/5/backup/overview client=192.168.0.57, traceId=2e9133ae03ca4f14, duration=210 ms] 2024-05-06 14:12:47.884 INFO 17654 --- [pool-prometheus-minute-schedule-1,5bdbe73a995c4848,ed1bc34cb0ba] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714975980, interval=60 2024-05-06 14:12:47.894 INFO 17654 --- [pool-prometheus-minute-schedule-1,5bdbe73a995c4848,ed1bc34cb0ba] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:47.975 INFO 17654 --- [pool-ocp-async-10,6faee8c88e41425d,381c19c537e0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:48.052 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-7,f3ceb4e88a114c97,4faf37bf0473] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?foldStandby=false, client=192.168.0.57, traceId=f3ceb4e88a114c97, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObClusterController.listObClusters(String,List,boolean,Boolean,WithRemote,List,Pageable), args=false,NONE,Page request [number: 0, size 2000, sort: name: ASC,obClusterId: ASC],] 2024-05-06 14:12:48.052 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,5e0e0072411242c8,7c9d474f40ed] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/1/tenants/5/backup/info?timeScopeType=LATEST_SEVEN_DAYS&startTime=2024-04-30T00%3A00%3A00%2B08%3A00&endTime=2024-05-06T23%3A59%3A59%2B08%3A00, client=192.168.0.57, traceId=5e0e0072411242c8, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ObTenantBackupController.parseBackupInfo(long,long,OffsetDateTime,OffsetDateTime,ObQueryTimeScopeType), args=1,5,2024-04-30T00:00+08:00,2024-05-06T23:59:59+08:00,LATEST_SEVEN_DAYS,] 2024-05-06 14:12:48.053 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,5e0e0072411242c8,7c9d474f40ed] c.oceanbase.backup.core.model.TimeScope : normalize time scope (startTime=2024-04-30T00:00+08:00, endTime=2024-05-06T23:59:59+08:00): passed 2024-05-06 14:12:48.054 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/1/tenants/5/backup/monitor/storage/stats?startTime=2024-04-29T14%3A12%3A46%2B08%3A00&endTime=2024-05-06T14%3A12%3A46%2B08%3A00, client=192.168.0.57, traceId=7038680fdfb74274, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ObTenantBackupController.queryStorageTrend(long,long,OffsetDateTime,OffsetDateTime,Pageable), args=1,5,2024-04-29T14:12:46+08:00,2024-05-06T14:12:46+08:00,Page request [number: 0, size 2000, sort: collectTime: DESC],] 2024-05-06 14:12:48.077 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,5e0e0072411242c8,7c9d474f40ed] c.o.o.b.i.BackupStrategyManagerFactory : isPhysical=true, isLogical=false, isPhysicalAndWasLogical=false 2024-05-06 14:12:48.079 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-7,f3ceb4e88a114c97,4faf37bf0473] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=192.168.0.57, traceId=f3ceb4e88a114c97, duration=33 ms] 2024-05-06 14:12:48.086 INFO 17654 --- [pool-ocp-schedules-18,3af9eb4e2c704ee6,6c89523a39bc] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-05-06 14:12:48.090 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,574a792887604005,0d4e34ea7729] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/1/tenants/5/backup/task/dataBackupTasks?page=1&size=10, client=192.168.0.57, traceId=574a792887604005, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObTenantBackupController.listDataBackupTasks(long,long,OffsetDateTime,OffsetDateTime,List,Long,Pageable), args=1,5,Page request [number: 0, size 10, sort: startTime: DESC],] 2024-05-06 14:12:48.102 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:48.103 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:48.103 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:48.104 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,5e0e0072411242c8,7c9d474f40ed] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:48.105 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id WHERE tenant_id = ? ORDER BY start_time DESC) where status in ('completed' ) and start_time >= '2024-04-29 14:12:46' and start_time <= '2024-05-06 14:12:46', args: [1008] 2024-05-06 14:12:48.113 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,5e0e0072411242c8,7c9d474f40ed] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:48.126 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,574a792887604005,0d4e34ea7729] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:48.128 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,574a792887604005,0d4e34ea7729] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:48.128 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,574a792887604005,0d4e34ea7729] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:48.129 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,574a792887604005,0d4e34ea7729] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id WHERE tenant_id = ? ORDER BY start_time DESC), args: [1008] 2024-05-06 14:12:48.141 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=weixiaoOBD, tenantName=sys, dbUser=root 2024-05-06 14:12:48.142 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:48.144 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:48.144 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:48.145 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT incarnation, round_id AS log_archive_round, tenant_id, path AS backup_dest, IF(start_scn_display != '', start_scn_display, NULL) AS min_first_time, IF(checkpoint_scn_display != '', checkpoint_scn_display, NULL) AS max_next_time, status, IF(checkpoint_scn != '', truncate((time_to_usec(now()) - checkpoint_scn / 1000) / 1000000, 4), NULL) AS delay, now(6) AS check_time FROM CDB_OB_ARCHIVELOG_SUMMARY WHERE tenant_id = ? AND round_id = (SELECT MAX(round_id) FROM CDB_OB_ARCHIVELOG_SUMMARY WHERE tenant_id = ?)) where min_first_time >= '2024-04-29 14:12:46' and min_first_time <= '2024-05-06 14:12:46', args: [1008, 1008] 2024-05-06 14:12:48.145 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-10,574a792887604005,0d4e34ea7729] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/1/tenants/5/backup/task/dataBackupTasks client=192.168.0.57, traceId=574a792887604005, duration=63 ms] 2024-05-06 14:12:48.163 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:48.164 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:127.0.0.1, sql port:2881 2024-05-06 14:12:48.164 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-05-06 14:12:48.164 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'time_zone' 2024-05-06 14:12:48.165 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.b.i.operation.BackupObOpsService : systemTenantZoneId=+08:00 2024-05-06 14:12:48.181 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.b.i.f.p.ProxyBackupServiceImpl : eventList = [ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-05-05T20:02:33.032307Z, obBackupEventType=END_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-05-05T20:00:05.054987Z, obBackupEventType=START_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-05-04T20:02:11.444764Z, obBackupEventType=END_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-05-04T20:00:06.889816Z, obBackupEventType=START_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-05-03T20:02:38.935152Z, obBackupEventType=END_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-05-03T20:00:07.783152Z, obBackupEventType=START_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-05-02T20:02:20.267217Z, obBackupEventType=END_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-05-02T20:00:08.015983Z, obBackupEventType=START_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-05-01T20:02:11.317374Z, obBackupEventType=END_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-05-01T20:00:05.463781Z, obBackupEventType=START_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-04-30T20:02:28.488714Z, obBackupEventType=END_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-04-30T20:00:06.740163Z, obBackupEventType=START_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-04-30T05:10:07.694231Z, obBackupEventType=END_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-04-30T05:07:41.963190Z, obBackupEventType=START_DATA_BACKUP), ObBackupEvent(clusterId=1, clusterName=weixiaoOBD, obClusterId=1714450365, tenantId=5, tenantName=weixiao, obTenantId=1008, eventTime=2024-04-30T13:07:10.534852+08:00, obBackupEventType=START_LOG_BACKUP)] 2024-05-06 14:12:48.184 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.b.i.BackupStrategyManagerFactory : isPhysical=true, isLogical=false, isPhysicalAndWasLogical=false 2024-05-06 14:12:48.210 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.b.i.m.PhysicalBackupStorageMonitor : tenantBackupUri=file:///obbackup/weixiaoOBD/1714450365/tenant_incarnation_1/1008/data/ 2024-05-06 14:12:48.214 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:48.216 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:48.267 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-4,5e0e0072411242c8,7c9d474f40ed] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/dumpPhysicalCheck, request body:DumpPhysicalBackupFileRequest(obPath=ObPath(installPath=/mnt/weixiaoOBD/oceanbase, dataPath=/mnt/weixiaoOBD/oceanbase/store, logPath=/mnt/weixiaoOBD/oceanbase/store, diskPathStyle=OBD, runPath=/mnt/weixiaoOBD/oceanbase), backupFilePath=file:///obbackup/weixiaoOBD/1714450365/incarnation_1, storageOption=), params:null 2024-05-06 14:12:48.277 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-4,5e0e0072411242c8,7c9d474f40ed] .b.i.d.f.p.PhysicalBackupFileCheckDumper : try dump backup file failed, hostId=1, backupFilePath=file:///obbackup/weixiaoOBD/1714450365/incarnation_1 com.oceanbase.ocp.executor.exception.HttpRequestFailedException: [AgentClient]:http request is failed, response:Execute shell command failed: failed to execute command: Command{user=admin, program=sh, outputType=combined, cmd=export LD_LIBRARY_PATH=/mnt/weixiaoOBD/oceanbase/lib:$LD_LIBRARY_PATH && /mnt/weixiaoOBD/oceanbase/bin/ob_admin dump_backup -q -c -d file:///obbackup/weixiaoOBD/1714450365/incarnation_1 2>&1, timeout=10s}, exitCode: 1, output: sudo: unknown user admin sudo: error initializing audit plugin sudoers_audit , error: exit status 1 at com.oceanbase.ocp.executor.internal.template.HttpTemplate.checkSuccess(HttpTemplate.java:476) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.doPost(HttpTemplate.java:286) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.post(HttpTemplate.java:114) at com.oceanbase.ocp.executor.executor.AgentExecutor.dumpPhysicalBackupFileCheck(AgentExecutor.java:637) at com.oceanbase.ocp.backup.internal.agent.BackupHostOperationService.dumpBackupFileCheck(BackupHostOperationService.java:180) at com.oceanbase.ocp.backup.internal.data.file.physical.PhysicalBackupFileCheckDumper.dumpCheckFileResult(PhysicalBackupFileCheckDumper.java:46) at com.oceanbase.ocp.backup.internal.data.file.physical.PhysicalFileUnifiedChecker.doesFileExist(PhysicalFileUnifiedChecker.java:42) at com.oceanbase.ocp.backup.internal.data.file.physical.PhysicalBackupFileManager.fileExists(PhysicalBackupFileManager.java:57) at com.oceanbase.ocp.backup.internal.BackupInfoManagerFactory.getPhysicalBackupInfoManager(BackupInfoManagerFactory.java:75) at com.oceanbase.ocp.backup.internal.BackupInfoManagerFactory.getBackupInfoManager(BackupInfoManagerFactory.java:92) at com.oceanbase.ocp.backup.internal.facadeimpl.proxy.ProxyBackupServiceImpl.parseObTenantBackupInfo(ProxyBackupServiceImpl.java:870) at com.oceanbase.ocp.server.common.controller.ObTenantBackupController.parseBackupInfo(ObTenantBackupController.java:143) at com.oceanbase.ocp.server.common.controller.ObTenantBackupController$$FastClassBySpringCGLIB$$a4f3c17.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor420.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:61) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controller.ObTenantBackupController$$EnhancerBySpringCGLIB$$8442b31d.parseBackupInfo() at sun.reflect.GeneratedMethodAccessor2465.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898) at javax.servlet.http.HttpServlet.service(HttpServlet.java:502) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:117) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) 2024-05-06 14:12:48.278 WARN 17654 --- [http-nio-0.0.0.0-8080-exec-4,5e0e0072411242c8,7c9d474f40ed] .b.i.d.f.p.PhysicalBackupFileCheckDumper : try dump backup file all failed, hostIdList=[1], backupFilePath=file:///obbackup/weixiaoOBD/1714450365/incarnation_1 2024-05-06 14:12:48.279 ERROR 17654 --- [http-nio-0.0.0.0-8080-exec-4,5e0e0072411242c8,7c9d474f40ed] c.o.o.b.i.BackupInfoManagerFactory : catch exception caused by [OCP UnexpectedException]: status=500 INTERNAL_SERVER_ERROR, errorCode=BACKUP_FILE_DUMP_FILE_ERROR, args=[1],file:///obbackup/weixiaoOBD/1714450365/incarnation_1 com.oceanbase.ocp.core.exception.UnexpectedException: [OCP UnexpectedException]: status=500 INTERNAL_SERVER_ERROR, errorCode=BACKUP_FILE_DUMP_FILE_ERROR, args=[1],file:///obbackup/weixiaoOBD/1714450365/incarnation_1 at com.oceanbase.ocp.backup.internal.data.file.physical.PhysicalBackupFileCheckDumper.dumpCheckFileResult(PhysicalBackupFileCheckDumper.java:52) at com.oceanbase.ocp.backup.internal.data.file.physical.PhysicalFileUnifiedChecker.doesFileExist(PhysicalFileUnifiedChecker.java:42) at com.oceanbase.ocp.backup.internal.data.file.physical.PhysicalBackupFileManager.fileExists(PhysicalBackupFileManager.java:57) at com.oceanbase.ocp.backup.internal.BackupInfoManagerFactory.getPhysicalBackupInfoManager(BackupInfoManagerFactory.java:75) at com.oceanbase.ocp.backup.internal.BackupInfoManagerFactory.getBackupInfoManager(BackupInfoManagerFactory.java:92) at com.oceanbase.ocp.backup.internal.facadeimpl.proxy.ProxyBackupServiceImpl.parseObTenantBackupInfo(ProxyBackupServiceImpl.java:870) at com.oceanbase.ocp.server.common.controller.ObTenantBackupController.parseBackupInfo(ObTenantBackupController.java:143) at com.oceanbase.ocp.server.common.controller.ObTenantBackupController$$FastClassBySpringCGLIB$$a4f3c17.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor420.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:61) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controller.ObTenantBackupController$$EnhancerBySpringCGLIB$$8442b31d.parseBackupInfo() at sun.reflect.GeneratedMethodAccessor2465.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898) at javax.servlet.http.HttpServlet.service(HttpServlet.java:502) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:117) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) 2024-05-06 14:12:48.287 ERROR 17654 --- [http-nio-0.0.0.0-8080-exec-4,5e0e0072411242c8,7c9d474f40ed] c.o.o.s.c.trace.RequestTracingAspect : Unexpected API Error: [GET /api/v2/ob/clusters/1/tenants/5/backup/info client=192.168.0.57, traceId=5e0e0072411242c8, args=1,5,2024-04-30T00:00+08:00,2024-05-06T23:59:59+08:00,LATEST_SEVEN_DAYS,, duration=233 ms] com.oceanbase.ocp.core.exception.UnexpectedException: [OCP UnexpectedException]: status=500 INTERNAL_SERVER_ERROR, errorCode=BACKUP_PARSER_CHECK_PHYSICAL_FILE_EXIST_ERROR, args=file:///obbackup/weixiaoOBD/1714450365/incarnation_1 at com.oceanbase.ocp.backup.internal.BackupInfoManagerFactory.getPhysicalBackupInfoManager(BackupInfoManagerFactory.java:83) at com.oceanbase.ocp.backup.internal.BackupInfoManagerFactory.getBackupInfoManager(BackupInfoManagerFactory.java:92) at com.oceanbase.ocp.backup.internal.facadeimpl.proxy.ProxyBackupServiceImpl.parseObTenantBackupInfo(ProxyBackupServiceImpl.java:870) at com.oceanbase.ocp.server.common.controller.ObTenantBackupController.parseBackupInfo(ObTenantBackupController.java:143) at com.oceanbase.ocp.server.common.controller.ObTenantBackupController$$FastClassBySpringCGLIB$$a4f3c17.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor420.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:61) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controller.ObTenantBackupController$$EnhancerBySpringCGLIB$$8442b31d.parseBackupInfo() at sun.reflect.GeneratedMethodAccessor2465.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898) at javax.servlet.http.HttpServlet.service(HttpServlet.java:502) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:117) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) 2024-05-06 14:12:48.354 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/exists, request body:CheckBackupFileExistsRequest(path=/obbackup/weixiaoOBD/1714450365/tenant_incarnation_1/1008/data/), params:null 2024-05-06 14:12:48.359 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:48.362 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:48.380 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/exists, request body:CheckBackupFileExistsRequest(path=/obbackup/weixiaoOBD/1714450365/tenant_incarnation_1/1008/data/), params:null 2024-05-06 14:12:48.385 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:48.388 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:48.404 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/find, request body:FindBackupFileRequest(path=/obbackup/weixiaoOBD/1714450365/tenant_incarnation_1/1008/data/, recursive=false), params:null 2024-05-06 14:12:48.452 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.b.i.m.PhysicalBackupStorageMonitor : tenantBackupUri=file:///obbackup/weixiaoOBD/1714450365/tenant_incarnation_1/1008/clog/ 2024-05-06 14:12:48.456 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:48.458 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:48.472 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/exists, request body:CheckBackupFileExistsRequest(path=/obbackup/weixiaoOBD/1714450365/tenant_incarnation_1/1008/clog/), params:null 2024-05-06 14:12:48.477 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:48.480 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:48.495 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/exists, request body:CheckBackupFileExistsRequest(path=/obbackup/weixiaoOBD/1714450365/tenant_incarnation_1/1008/clog/), params:null 2024-05-06 14:12:48.501 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-05-06 14:12:48.504 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-05-06 14:12:48.519 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://127.0.0.1:62888/api/v1/backup/file/find, request body:FindBackupFileRequest(path=/obbackup/weixiaoOBD/1714450365/tenant_incarnation_1/1008/clog/, recursive=false), params:null 2024-05-06 14:12:48.751 INFO 17654 --- [http-nio-0.0.0.0-8080-exec-6,7038680fdfb74274,1949a9337e18] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/1/tenants/5/backup/monitor/storage/stats client=192.168.0.57, traceId=7038680fdfb74274, duration=705 ms] 2024-05-06 14:12:49.174 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 172.17.0.1:8080 refreshes policies... 2024-05-06 14:12:49.175 INFO 17654 --- [pool-7-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-05-06 14:12:49.332 INFO 17654 --- [pool-ocp-schedules-9,0030a16cca0f4e38,affa2c2d8195] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-05-06 14:12:49.352 INFO 17654 --- [pool-ocp-schedules-9,0030a16cca0f4e38,affa2c2d8195] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[14042fae-d248-4b59-871d-9663e4519504] 2024-05-06 14:12:49.352 INFO 17654 --- [pool-ocp-schedules-9,0030a16cca0f4e38,affa2c2d8195] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[14042fae-d248-4b59-871d-9663e4519504] 2024-05-06 14:12:49.482 WARN 17654 --- [pool-ocp-async-2,c3b16f1c27d640c7,7d9dbb591a62] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:49.975 INFO 17654 --- [pool-ocp-async-4,90aab8584a3d4393,6a725005b382] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-05-06 14:12:50.260 INFO 17654 --- [pool-ocp-async-8,e410b5e870b5408e,36d6ec2d0b23] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-05-06 14:12:50.274 WARN 17654 --- [pool-scanner-115275354-1,e410b5e870b5408e,976dda627fbf] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 6 2024-05-06 14:12:50.575 INFO 17654 --- [alarm-task-1,9d1cb1ba51044be6,9a487cc7496d] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-05-06T14:12:50.574270+08:00, lastProcessTime=2024-05-06T14:12:40.537398+08:00 2024-05-06 14:12:50.884 INFO 17654 --- [pool-prometheus-minute-schedule-1,8329c42a51714bd0,473a5067e787] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1714975980, interval=60 2024-05-06 14:12:50.887 INFO 17654 --- [alarm-task-1,9d1cb1ba51044be6,9a487cc7496d] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-05-06T14:12:50.574270+08:00 2024-05-06 14:12:50.890 INFO 17654 --- [pool-prometheus-minute-schedule-1,8329c42a51714bd0,473a5067e787] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=3, collectTaskCount=3 2024-05-06 14:12:51.483 WARN 17654 --- [pool-ocp-async-9,6297bd8a0fe245ee,6e11c217559a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-05-06 14:12:51.975 INFO 17654 --- [pool-ocp-async-8,699ceaa1fe544284,bd8a800528fa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents ^C